DOCUMENT RESUME 



ED 383 815 

TITLE 

INSTITUTION 
PUB DATE 
NOTE 

PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



UD 030 487 

Chapter 1 Successful Schools. Technical Papers. 
1993-94. 

Florida State Dept. of Education, Tallahassee. 
94 

92p.; For the related pilot project report, see UD 
030 488. 

Reports - Evaluative/Feasibility (142) 
MF01/PC04 Plus Postage. 

Academic Achievement; '"'Compensatory Education; 
Cooperation; Educational Research; ^Elementary 
Education; Literature Reviews; Parent Attitudes; 
Pilot Projects; Poverty; '^Profiles; Program 
Evaluation; Research Methodology; School District 
Wealth; ^School Effectiveness 

''^Education Consolidation Improvement Act Chapter 1; 
'■^Florida; Technical Notes 



ABSTRACT 

The Chapter 1 Successful Schools project is the 
product of collaborative development efforts by the Florida 
Department of Education, the state's Chapter 1 Evaluation Advisory 
Panel, and Technical Assistance Centers contracted through the 
Educational Testing Service. This report covers the initial pilot 
phase of the Successful Schools project. It is a companion document 
to the summary report released in October 1994. It contains a number 
of technical papers on which research summaries, findings, and 
conclusions were based. It is organized to be generally consistent 
with the summary report, and contains the following sections: (1) 
introduction; (2) impact of school poverty on Florida's elementary 
schools; (3) conditions related to student achievement and learning 
environment; (4) successful high poverty schools; (5) data base 
profiles of participating schools; (6) school staff and parent 
perceptions of effective school components; (7) successful schools 
staff survey, technical report; (8) what parents did and did not say 
about pilot project schools; (9) parent survey responses; (10) 
interview analysis from the successful high poverty schools study; 
and (11) procedural analysis of on-site visits in the Successful 
Schools study. Twenty-five tables illustrate the discussions. 
(Contains 22 references.) (SLD) 
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• Adapting and field testing staff and parent survey instruments that were based on 
previous, "effective" schools research; and 

• Visiting a sample of high poverty schools to observe and conduct interviews to enrich 
paper and pencil survey data. 

This is a companion document to the Successful Schools summary report to be released in 
October of 1994. It contains a number of technical papers upon which research summaries, 
findings and conclusions were based. It is organized to be generally consistent with the 
summary report and contains the following sections: 

Data Base Analysis 
Section 2: Impact of School Poverty on Florida's Elementary Schools 
Section 3: Conditions Related to Student Achievement and Learning Environment 
Section 4: Against All Odds: Successful High Poverty Schools 
Section 5: Data Base Profiles of Schools that Participated in the Pilot Phase of 
Florida's Successful Schools Project 

Staff and Parent Surveys 

Section 6: School Staff and Parent Perceptions of Effective School Components 

In the Florida Successful Schools Project 
Section 7: Successful Schools Staff Survey, Technical Report 
Section 8: What Parents Said (and Did Not Say) about Pilot Project Schools 
Section 9: Parent Survey, Responses to Open-Ended Questions 

On-Site Observation and Interviews 

Section 10: Successful High Poverty Schools Study, On-Site Interview Analysis 
Section 11: Successful Schools Study, Procedural Analysis of On-Site Visits 

These papers were developed as a joint effort between the Florida Dq)artment of Education, 
the Chapter 1 Evaluation Advisory Panel (see list on page 86), the Technical Assistance 
Centers in Atlanta. 
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Section 2: Impact of School Poverty on Florida's Elementary Schools 

The purpose of this section of the interim report on Horida's Chapter 1 Successfiil Schools 
Sc^t^S examine relationships between school poverty and some of me many factors fta 
T^o^ ^rceptions about the quaUty of education in Florida schools T\^^<l;f ^ " 
c^t^lish me loader context of the Successful Schools study-which seete to i^^ 

^tributes of effective, high poverty ^hool^-^^r't^ 'S' 3"^^^^^ 
student achievement, learning environment, student charactensucs and school mputs. As will 
^sS!^ me w^itration If poor students in schools affects almost everymmg about schools 
that is measured and reported uniformly through me state data base. 

Twenty school related variables were chosen for analysis wimin me context of low. medium 
LdlSh P^^^ schools. Many of me variables can be tied diiectiy to one or more of tfie 
^to glSed under Blueprint 2000; the remainder are related to student charact«ish^ 
S schools or me human and financial resources which s^ ^^^f^.'^^l 
used to examine me impact of poverty was taken directly from me 1992-93 Honda School 
Reports-elementary version. 

Srhnnl Poverty 

From a national perspective, poverty among American chUdren remains a P«vasive. negative 
hS^ce on eduSal excellence, despite years of concerted efforts to aUev^to me ^us« of 
and renewed efforts at school reform. A generation after me great "War on Poverty 
National Assessment of Cb^ter 1 (1992) indicated mat conditions have not 

improved: 

As poverty among me elderly fell in me 1980's. children became me poorest of all 
AmScans. m 1^>1, more man 13 million children in me United State-more man one 
in five~Uve in femiUes wim income below me poverty line (Committee on Ways and 
Means. 1992). In 1990. 8.6 miUion school-age chUdrcn (ages 5-17) were Uvmg m 
poverty (US. Department of Labor. 1990). 

Recent increases in me number of poor children in Florida are not as high as in many omer 
states, but me overall poverty level remains sUghtiy higher man me national average. 
According to Hodgkinson (1993): 

Tlie number of children in Horida who are poor increased from 18.5 pwcent to 19.9 
percent during me 1980's. while nationwide this figure increased from 16.0 percent to 
19.5 percent. 

Coming from a low income background is one thing, attending a high poverty school is quite 
another. However dd)ilitating femUy poverty may be on individual childrw>. contcmpwwy 
research studies point out that high concentrations of poor students m schools, not «» POVcrty 
Stosofindivid^tudents.!, the major problem. In a KAPPAN^ on Ac Childrw o^ 
Poverty (1990). me featured aumors (Kns^ and Shields) summarized me problems associated 
wim high poverty schools: 

nic challenge of educating the children of poverty has long been rccogniaed as a 
difficult one. Not only do many of mesc children perform poorly on academic tasks. 



but also the typical school serving large numbers of such children feces a variety of 
problems that pose barriers to providing a high-quality education, among them: high 
rates of mobiUty among students' famiUes, a Isigh incidence of severe emotional or 
behavioral problems among students, large numbers of students with hmited 
proficiency in EngUsh, low staff morale, and inadequate faciUties and resources. The 
chUdren from poor famiUes and, to some extent, all children who attend such schools- 
are at a disadvantage in the pursuit of learning. 

The poverty status of individual students, whUe important, has Uttie practical significance in 
isolation of the school setting in which instruction is provided. 

The eeneral descriptions of high poverty schools suggest conditions which are antithetical to 
the current vision of school reform and the lofty goals of Blueprint 2000. Schools ftat serve 
large numbers of poor students are characterized as having low student achievement, disaplme 
and attendance problems, high turnover rates among students and teachers, and inadequate 
resources. Under Blueprint 2000 in Horida, the aim is to have aU students achievmg at high 
levels in safe and orderly schools with adequate fecilities, and resources. 

If conditions in high poverty schools are as bad as the current Uterature suggests, then thtae 
schools would have to be the primary targets for concerted improvement acUviUes. To do 
otherwise would ignore the tremendous liabiHty associated with business as usual m high 
poverty schools. But first, it is important to verify the general condition of schools serving 
toge numbers of poor children in our state with sufficient detail that constructive 
improvements can be made and recognized. In the process of investigating the effects of 
poverty in general, it will also productive to search for counter-examples-high poverty schools 
that actually do quite well and could serve as appropriate models for less successfiil, but 
demographically similar schools. 

School Pover ty riassification 

Though far from perfect, one of the most common and most convenient ways of looking at 
school poverty is in terms of the relative concentration (percent) of students who receive Free 
or Reduced Price Lunch (FRL). In 1992-93 the percent of elementary students receivmg 
federally subsidized meals in Horida ranged from zero to 99% with 46.7% being the median. 
With the aim of dividing schools into low, medium, and high poverty groups, a dassificatoon 
scheme estabUshed by Jung and Orland (1986) was used to determine which schools were m 
the lower, middle and upper quartiles of poverty according to the percent of students on Free 
or Reduced Price Lunch. 

Horida schools which ranked among the lowest quartile in terms of the percent of studwt 
membership on FRL (zero to 29.2%) were classified as low poverty. Schools in the middle 
two quartUes of students on FRL (29.3% to 64.7%) were classified as medium povwty. 
Schools in the upper quartUe of students on FRL (64.8% to 98.9%) were classified as Wgh 
poverty. Using this approach, 353 (or 24%) of Horida's elementary schools were classified as 
low poverty, 737 (or 51%) were classified medium poverty, and 368 (or 25%) were classified 
high poverty. The total number of dementary schools in the analysis was 1,458. 
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Almost aU of tte variables used to examine ^ ^ e«»«ed from 

^r^l W^S Florida school Reports, T"!"^'^ summarized into school 

Se^p^ent of Education's Snrfott »f f-^^^rld high schools in the st«e. 
^T^gregates that were Panted to an den»«^^ ^ 
BespiB extensive eftots to ven^ f^^^„^U from individual schools and there 
Sn^cies exist ^^^^"^^Z^ ^ 

;s:t^:s^Sair.r^«st:;eoffic..ecords. 

^ the Horida school Re^^^"^^ SSMT^^^ '^'^ s 
of students scoring above the na^ ^ » ^ to absolute '^'^ 

attendance rate); however, '^.^^Z For purposes of uniform analyas, Honda 
^^tures per M-Tin« E,m«l«t^t,rf«^ F^JP^ ^ 

c Xnni RcDort data were considered to 8^"'=;*"^ , . . tenns of being higher or 
a^cSttf figures can beco,n^tooU»^mU«san«^^ 

U)v«r, but the differences are not u"''™: »JT ^Accordingly, analyses were condu«ed 
^S.ly the most appropriaK CL, 1992), whid. can be vk«ed » 

Lne a non-parametric test of medians (SKgei. group of schools 

^ Z^^^rTc^ ^^ri gr^-er than or less than (or 
^^S^^itoKgroupofelementaryschools. 

, ~ ™ri ihdi associated probabiUties that categories of 
.n«stalisti«d results are chi^«ai« '^»«»^ ^ ^te ba^ 

lyerty are independent of (unrda'ed «» J""^^^;;^ ^ shown in order to ftolitate 
StorHo^er,inthe*splayof|««^Bj^^^^^^^ I, is importarit to 

"d^ S co^ ■o-fi-- fto" 

ftir «ich variable. Effect oie 
Addi.ion.ny, esttmates of f?^^ mT"vi« 
ebsificadOTS, when u sed as "^^SSST calculation s *« made 

when sorting through ^'T'^Xi^ ^SSopriate for the types of datt and the 
uang a procedure described by Cohen (1^ '^^^^^ in terms of the imp«t of 
SfionS^taduded in «»dy- f'^T^'^?^ 

Sisinj poverty levels on '^y^^,^^^Z^i««^y ''^ ®' ""^ "l 
SSte,^ si»» of ;f *|<^;°» JX^20 »d abU .« dassilijd ukW 
thmuBh 19 reflect medium (M) effects, ano ^ ^ of discrepancies between 

m '^^•^i^erSw"Srm^r«iv«. ^^XionsHp with 

to low, medium, and high poverty schools. 



^^^1 p^«iv and stiidrn t A(iliicvcmBil 



in the area of student »eM«r*"''^S ^aHSTW «*ievem«.t .nea««« 
which were b..«J on ^,V«!^^^,^Z6o«i medi». on nonn..*te«c«l 
include: (I)** percent of «ud«B»«»W»^ 
tests in reading comprehension, (2) the percent iconn» 



.fcrcnccd tests in B.th applications or its cquiv^«^d (3) ^^P^-~ ^r^^^^ 
Table l: Impact of Poverty on Student Achievement 



Medians by School Poverty Level 
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Achievement Variable 
(4th Grade Students) 
% Scoring above 
Kational Med ian-Reading 
% Scoring iabove 
Kational Median-Math_ 
% Scoring at or above 
^gnou Mid point-Writing 

«f first measures of student performance that com«5S 
Reading achievement ^^^^^I^^^^^S in high poverty scHools score lo^r m 

Asshownabove.thereisac.ear^^^^^^^ 

the relative poverty l^^^^J^^^^^ ' t^S^st^ median and even further below tiie 
poverty schools tends to be far ^°^*^°X)^^lle percent of fourth graders scormg 
Shievement level of students in low P^^^^^f*^ J^ut^and a half times less than m 

above the national median in high 1^^^^^°^^^ schools (16%) that had rea^ 

low poverty schools. ^^^^^^tTJZ^^s 

scores above the statewide medianfor ^ ^y schools. 

schools (9%) had reading scores above the median tor low pu 

1 — iH/ifJi? Like reading, math would 

liidy be a compmion i«di(ator of in TAte 1, it can be seen 

perfbrmance on nadonaUy sBmtotod ^•J'^ ^ ^Is. Students in tagh 
achievement was also depend^ ^J^^^"^ u« slate and much lower than 
p<„erty schools tended to score Uwtt U^J«»^ 

STin^J^^sTSS'tas^j^-^S^rrJ^^^ 

sum. «* as wri(i»« ? Wiitint P«»f<»™»^j'!L^^ was expressed in terms of the 
U: Rather than using -»tt'»»^2««^jS^"leas^ nLnal <paUty ( -r or 

^«„,c but may contain •xtran«ou« or 
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SbeM'ong the most P«>r«",l?^ dear ttot the lowest p«tfonmi«sclK)oto 

iS^efforts to ascompUsh Btaepnnt 2000 s " " "^^t^B torn kw inco™ lilies. 

Without caieM attention to these scnoou, 
SSLTnorida's school «ft,rm policy. 

rSta^^*c leaning envi™™.«t^ ^ * '^'^^'^i.^t fourth gr»te 
tJ^^olon. attendaneeajd «^'"^^°S^'Ses in this group, there were 

Sg^SsTc^'^i^tS'-f---^--'*"''- 

.,h.2: ,n.p,ctofP.ve«,onrr»««.<».AtU»a»«e.»..S.spens.oo^ 

■^SSSTEy School Poverty i^ci 



Data Base Variable 
^ AH fitade Levels) 



AHftndanceRate 
Out-of-School 
ytiitn eiiMon Rate 



Low _ 


MetU- 

I mn 


High 1 


Total 


97% _ 


1 96% _ 


91% ' 


i 95%_ 


95% _ 


1 94% _ 


94% 


1 94%_ 


.5% 


1 1.2% _ 


1.6% 


1 1.1% 



207.5 
192.8 



88.4 



^ nni I .13 (M 



^ nni I .06 (S)_ 



suspension xws %, ^ . 

^ ^«c« rate in a ich<». r^r^V^^^^^^lz:. 
^^lyg^t Of sldlb Which «e *Ttr"SL J^g behind one's «ta«»l?P^ J^. 

«•« contain •o«« 



is commonly vicw«i« — T-Z. 

. - lAmmm and »»y contain ao** 
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propensity toward dropping out. This is especially important in Florida, ^^^.^^^^^y 

dropouts m 1992-93 were one or more years over age. Are studems in high poverty schools 

promoted at a lower rate than students in other schools? 

The data in Table 2 show that a school's promotion rate is somewhat dependent on its poverty 
level. The median promotion rate in high poverty schools was about five Pfr<^';^g^f";^ 
less than the statewide figure for all schools and about six peri^ntage pomts less than m low 
Svem^schools. At the same time, there were a number of exceptions; 72 lugh Pov«ty 
Siools (20%) had promotion rates equal to or higher than the statewide median and 34 (or 
9%) had promotion rates tiiat were the same or better than in low poverty schools. 

Eow does student attendance in high poverty schools compare? While school attendanceZ. at 
^iTL^.is related to students' opportunity to learn, differences m actual rates^nong 
^ meSumT and high poverty schools were relatively small. Just over one percent SQ«rates 
r'mSrfoThigh poverty versus all schools and less than 2% separates tiiem from low 
S^veT^h^k. Though pS^erty level was found to be statistically related to attendance and 
rS^^S^effect was ctossifii as medium, tiie absolute difference between group medians 
was extremely small. 

Susoension especially tiie kind tiiat physically removes children from tiie learning 
Sm^t. T^iJly viewed as a negative reflection on the safe and orderly «ivm,nm^t 
S g^ s(^S(^s are supposed to provide. This is especially true in view of tiie statewide 
St in-school s^sions a viable alternative to pushing children out. unless tiie 

^ture of tiie behavioral problem is severe. Are students in high poverty schools suspended 
more frequently? 

Though relatively low in most cases, out-of-school suspension rates are at least partially 
dependent on school poverty. In high poverty schools tiie mectiaa suspension vos^ 
tl^ times higher tiian in low poverty schools. While statistically sigmfiwnt. the «fta5t sia 
r^vSty on suspension rates was relatively small, which is probably a «fl«^on of 
sus^sion poUdes which affect all schools in a particular distnct As ^i* o*tf v«i^l«^ 
many high poverty schools had low suspension rates. In feet. 138 high poverty schools ^8%) 
eq^ toor lower tium tiie state median, and 96 ( or 26%) had rates equal to or lower 
tiian tiie median for low poverty schools. 

Summary 

While not as dramatic or newsworthy as shident achievement, promotion, attendance, and 
suspension rates do have a bearing on tiie quaUty of education available to stiideats in Honda. 
ThTsummary findings in tiiis area indicate tiiat schools which serve a proportionately laj^e 
number children have lower promotion and higher out-^-schcj^ S^^™ 

(While attendance rates were also lower, tiicrc do not appear to be substantive <if 
Effect sizes were found to be medium to small in contrast witii large effect sizm for stiidart 
achievement. Also, tiiere were notable exceptions to tiie general trend-many high poverty 

2Th. r«lativ« lack of distinction among attandanca rata, may b. * 

praaant + numbar of daya ab.ant, ragardlass of tha langth of school 
gj^^ anrollmant. ^ 



schools tave promotion and suspension ra.«> !ha. rival even low poverty schools. 

f^fj n anil StI lllHIt r'ha""'"'^'''' 

. sMent ch^ac^sfics which »e S^tSewhT^'S^S 
least two masons ^'^■ll»;;'^^J^tS^*Ltri the establishoKnt of vi^le 
high poverty schools. ^3 and not so successful school ates. The 

technical asastance l^^^.^^Tf^^^Z leoort do not reflect student achievement or 
variabte under tovesti^-^XTth^ Wp «te focus of ^search so that podtive 

related indicators, p« se,rato.thq^ MP tt^ appropriate settings whete 

exemplars among high pov«^ scnoois isa 
impiovement efJMts are needed the roost. 

Vindicators Of uni,ue^^^~^^ 

Limited EngUsh ^^^^ ^^^.^^ medium and high poverty schools on aU three 
significant differences (p< .Wl)^^^ data in Table 3 suggest that 

student characteristic vanables^ut ^^^^^e^ ^ of their 

high poverty schools tend to ^^^^ ~h«^^Sobmty rates. Jthe other hand, 

Tpl^nrrr^h^T^^^^ of other 

l^g^^ (ESOL) is less affected by poverty level, m Honda at least. 

Table 3: Impact of Poverty on Student Characteristics 




Chi- 
Sauare 




Effect 
Size 


335.3 


<.001 


.23 (L) 


41.1 


<.001 


.03 


146.6 


<.001 


.10 (M) 
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low poverty schools. 

3Hl„orlty .tud.nt. Includ. Hl.p«.lc, x.l.n or Pacific 
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Exceptions to this trends are rarer than for most other variables examined; only 35 high 
novertv schools (1096) were below the state median for minority composition and only 13 (or 
496) were below the median for low poverty schools. These data argue strongly that minority 
composition will be an important consideration when developing technical assistance lmka«es 
between successful schools and those that clearly need to improve stiident achievement and/or 
processes. The most help for low performing schools can be gained from schools with similar 
student characteristics. 

75 there a higher prevalence of Limited English Proficient students in high poverty schools? 
Though statistically significant, the relationship between the percent of m» stunts m a 
school and its pov<ity level is weak. On the one hand, high poverty schools have a 
proportion of LEP students than observed statewide. On the other hand, the overall trend is 
^ontory to the pattern observed so far-medium. not low. poverty schools have the smallest 
percentege of LEP students. Regional differences probably account for more difference 
among schools than does poverty, hence its negligible effect size. 

A hieh degree of stiident tiimover or mobility is often cited as a characteristic of high poverty 
schools, the premise being that economic hardships make it difficult to mamtom a pwmanent 
Lden^. Are mobiUty rates in high poverty schools higher than in other schoob? Tht^ 
in Table 3 indicate that mobility is somewhat dependent on school poverty level. The median 
mobiKty rate for high poverty schools was nine percentage points higher that tiie statewide 
figure and 19 percentage points higher than observed for low poverty schools WMe ;rt)out a 
qirter of high poverty schools had mobiUty rates bdow the state median, only 8% had rates 
bdow the median for low poverty schools. Ttie existence of a sigmficantly higher stiident turn 
over rate can be seen to affect the opportimity which stiidents have to learn m a stable 
environment, as weU as the opportimity which teachers have to provide adequate mstruction. 

Siitnmarv 

Analysis of the relationship betiveen poverty levels and selected stiident charact«istics yidds 
somewhat mixed results. On the one hand, there is a very strong relationship betiiveai high 
poverty and high minority composition in schools. The relationship betiveen povwQrand 
student mobiUty was considerable, as weU. These findings arc consistent with general trwds 
nationwide. On the other hand, a very small effect size was found for the percent of Limited 
English Proficient stiidents in low. medium and high poverty schools. 

Poverty an ^ Srhnni Inputs 

School inputs reflect the adequacy of human and financial resources which schools have at 
their disposal to meet the high standards for stiident learning which arc expected under 
Blueprint 2000. The Horida School Report variables chosen for closer examination mclude: 



^ School size. 
^ Class size. 
^ Support staff. 

^ "Regular" program expenditures, consisting of 
^ Per pupil expenditiircs from general, plus 
^ Federal fund sources. 

10 
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^ First year teachers, 
-/ Experiaiced teachers 

✓ Teachers with advanced degrees, 
Teacher salaries, and 

✓ Minority teachers. 

, . r- ♦ j-4v-««/.»c (r.^ nnn were found between low, medium and high poverty 
S ^"^"in^uTSiru-S^lavc ^ ^ sisnific^ce) 

ranged from minimal to large. 

vranv of the same input variables were examined in a recent, national study of Ae impact of 

t^t^^. t^^^ZTZ. applicS to the cun^t study of pov^m^^^^ 
ShoT R^lts from the two studies can sometimes be compared to assist m mterpretation. 

Table 4a: Impact of Poverty on School Inputs 
School Sire, Class Size, and Support Staff 
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Medians by School Poverty Level 








DataBase Variable 


Low 


Medi- 
um 


High 


Total 


Chi- 
Sguare 




Effect 
Size 


School Size 


765 


682 


632 


685 


26.7 


<.001 


.02 


QassSize (K-5) 


25 


25 


24 


25 


24.3 


<.001 


.02 


Number of Support Staff 
(Per 500 Students) 


12 


15 


19 


15 


64.3 


<.001 


.05(8) 



one of the most otraous features about schools is the number of students *^ «"«;^'^«* 

'ZZ^^Zms? kse qSons were examined by looking at the tool number of 
Zi^T^lWduting the Oaober, 1992 FaU Student Survey count. The data m T«>>1«^ 
STLT^thS al^ticali; agnificant relationship between school «ze and pov^ 

ta^^ is mininud. N<iertheless, an examination of median sdwol 
^«;^te^^poverty schools actually have tew«: students dnn medium or low pov«9 
S m Sf A^ces were reUtivdy smdl »ul appanrntiy l*d«d cons«tency wrthm 

poverty categories. 

Beyond the sheer numbers of students attending a particular school, crowded clf /eo^JJ "J 
^ citeS^ a condition that characterizes high poverQr schools ^ tiie detom«it o^ 
ScS quality. Do high poverty schoob have larger class sizes? mdato mTabte 4a 
Sr^^So^l ^vcr^on class size^ was statistically significant, but mimmal. 

S,or th. 1992-93 Florid. School R.port.^ cU..-.i» w.. d.t.«r«in«l by th. 
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According to data in the Rorida School Reports, class size actually decreases as tiie 
concentration of poor students increases. 

In addition to teachers and administrators, an important ingredient of a schoors human 
resources can be found in its support staff. Beyond a standard complement of clencal, food 
service, transportation and custodial staff, there can be teachers on special assignment, 
administraive assistants, health service providers, teacher aides, tutors, computer spe<^sts, 
Brsourcc officers-and many others. Do high poverty schools employ more support st(^than 
medium and low poverty schools? 

In order to address this question, tiie relative number of support staff was calculated per 500 
students to put the figures on tiie same basis for all schools, as was done in a rdated national 
study Chambers, et al (1993). The data in Table 4a suggest that high poverty schools do have 
substantially higher numbers of support staff than are found in low or medium poverty 
schools. On average, high poverty schools had about four more support staff than me<hum 
poverty schools and about seven more than low poverty schools (per 500 students). This 
finding is consistent witii the national study of Chapter 1 resources, but needs to be fiirAar 
examined in terms of tiie precise composition of "support staff," which is not clearly specified 
in tiie Florida School Reports. Also, differences in training and assignments need to be 
explored, especially in view of a recent position paper for the International Readmg 
Association, Rubin (1994) asserts tiiat " . . . 85% of Chapter 1 schools witii high poverty 
levels rely on untrained aides . . . individuals witii Uttie or no training above a high school 
diploma." 

Pnverfv and g tiidpnt Expenditures 

Types and amounts of financial resources are among tiie most important school inputs tiiat can 
be readily identified. Horida School Reports contain several indicators of resource availabiUty 
witii "Regular Program" expendituics^ being perhaps tiie most common. Regular program 
expenditures include two major components: general funds (local and state general revenue) 
and federal funds (primarily Chapter 1 for elementary schools). The overall research question 
was: Do high poverty schools have fewer financial resources than their lower poverty 
counterparts in the same district? Are there differences in types offimds expended? 

Financial data tend to be compUcated by unequal expenditures among school districts and type 
of school. For example, distiicts witii a larger tax base and/or higher cost of Uving spwd 
more tiian otiier districts; tiie cost of instruction in high schools is typically more tiian required 
in elementary schools. One way to isolate tiie impact of poverty from otiier fectors is to look 
at tiie difference between each school's per pupU expenditure and tiieir own district's average. 
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unduplic«t.d count of .tud.nt. .nrolLd in .p«cifi.d cour... JJ;^"*? .Jj, 
unduplic«t«d count of taachars in tho«« uaam coursas. Al.o, th« '©"owin^ 
di«cliim«r apMars in th« T«chnic«l V«r«iont -Th« avarag* claaa-aisa may or 
2ij nSrJSfJSS tha actual nu«b.r of atudanta in a givan cl..^ ^"TTH' 
dSia rapraaant an avaraga numbar of atudanta within tha aubjact araaa or 
gradaa indicatad." 

6«xpandituraa includa* aalariaa + banafita + purchaaad ■•^1-caa + matariala 

and^Sppli" + othar diract axpanaaa + capital outlay + achool indiract coat + 
diatrict indiract coat. 
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Accordingly, the data in Table 4b show expenditure differences in low. "[^"^ ta^^ 
^W^h^ls as a percent of their district's average expenditures. Data ^ P~vid^/°^ 
SKX" Prog^ ^"ds, as weU as the two major components of such funds^general 

and federal. 

Table 4b: Impact of Poverty on School Inputs 
"Regular" Program (General + Federal) Expenditure Differences 
As a Percent of the District Average 





Medians by School Poverty Level 








Percent More or Less 


Low 


Medi- 
um 


High 


Total 


Chi- 
Square 




Effect 
Size 


Than District Average 
"Regular" Per Pupil 


_ 


-1% 


+ 8% 


0% 


117.3 


<.001 


.08 (S) 


Expenditure Deferences 












^^^MS■^x•:■^■:>■.■.-.-:■'..■..■4 


.01 


General Fund 




-2% 


-1% 


-2% 


15.2 


.001 


Component 

Federal Fund 
romponent 


-79% 


4-25% 


+W% 


4-28% 


1 289.3 


<.001 


.20 (L) 



■n^ in T»hte 4b sneeest that "regular" expenditmes are at least somewiiat d^emlent on 
^ of schXbmnot to the dinSon one might expect. High poverty sd»oh 
^Si^^rs^ about 8« more per pupU than th«r distri« ave.age»d ov« 
Vr« Z^ttuTta low powrty schools. Thus, contrary to popular notions, iiatoiuate 
n^Ja^Scteriie schools that serve large numbers of students from tow 
STfi^'^S^rrS story is not revealed by looldng simply at what .he 
Horida School Reports show as "regular program" expenditures. 

Analysis of the general fund component of regular program «P«»^I^^^^^*^J 
^Sly sip^fi^t, but minimal impact associated with school Pov^jj; TJeJa^^ 
Sal (tiffttcnccs among low, medium and high poverty schools, which if myUung ftvor 
S;:Sr^h^rS?^c inLasiilg larger numbers of children from low ^come femihes. TTus 
finding is generally consistent with the national study of Chapter 1. 

Th.. federal fund component was calculated by subtracting general expenditures from what 
r^^S^-^fulS^"^^^^ in the 1992-93 Horida School Reports imamed f^ 
schMls was nwdnly Chapter 1 funds that are supposed to supplement lood and stete 
^i^C^ut^erLeal relatively large differences that fevor high pover^ 
STove™ ^medium and low poverty schools. IHis finding would suggest Aa^ m 

in Horida are'«>ncentrated where there are large numbers of children 
from low income families, as intended by federal legislauon. 
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Table 4c: Impact of Poverty on School Inputs 
Teacher Experience, Trainins, Salaries, and Minority Composition 





Medians by School Poverty Level 






Data Base Variable 


Low 


Medi- 

urn 


High 


Total 


Chi- 
Square 


P 


Effect 
Size 


First Year Teachers 


4% 


4% 


8% 


5% 


72.5 


<.001 


.05 (S) 


Experienced Teachers 


59% 


56% 


48% 


55% 


46.1 


<.001 


.03 


Teachers with 

Advanced Degrees 

Teacher Salaries as a % of 
The District Average 


35% 


31% 


31% 


32% 


22.3 


<.001 


02 


+ 1% 


+ 1% 


-2% 


0% 


56.2 


<.001 


.04 


Minority Teachers 


14% 


13% 


28% 


16% 


146.4 


<.001 


.10 (M) 



THe experience level of teachers in a school is sometimes dted as a ^^r that affects tii^ 
quaUty of instruction and also differentiates schools servmg large numbers of poor students. 
Do high poverty schools have more inexperienced teachers? 

The proportion of first year teachers in a school reflects Ae lowest level of '^f^ 
experien^ among a school's certified staff. TTie data in Table 4c P^/"PP?«/°L; 
statistically significant, but relatively small relationship between the pwccnt of first yw 
teachers and school poverty level. Closer examination shows that the median poowi of firrt 
year teachers in high poverty schools was about double what was found m both low and 
medium poverty schools. Also, it is important to note that the percent 
was exactty the same in low and medium poverty schools. Smce the ^erencc vm 
concentrated in high poverty schools, it is possible that the educational agmfican<» of this 
variable is somewhat understated in the statistical results. Rather, these data woidd tend to 
confirm that high poverty schools typically employ more inexperienced (first year) teachers. 
SJ^Tfindings aTgenerally consistent with the national study of Cte^ter 1 resources 
previously cited. 

ITie proportion of teachers in a school who have at least ten years' experience and have setfl(^ 
into tiie profession is another variable that can have at least an indirect mfluencc on the quality 
of instruction available in a school. Do high poverty schools have fewer seasoned instructional 
personnel? 

The data in Table 4c show a statistically significant, but minimal relationship b<rtween ^her 
experience and school poverty levds. As expected, high poverty schools arc m fact staffed by 
prOTortionatdy fewer experienced teachers, those with at least 10 years 
More than anything else, these data simply complement the previous findmg that showed high 
poverty schools have more first year teachers. 

Tbt proportion of teachers with advanced degrees is indicative of the relative level of trwmng 
that teachers have in a particular school. WhUe the differences among high, medium, and low 
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poverty schools were statisticaUy significant, the effect size was negligible for this variable. 
However, this finding is generally consistent with the trend observed m the national study of 
Chapter 1. 

Difference in teacher salaries among low, medium and high poverty schools can also be 
viewed as an indirect reflection of how resources are expended to provide the quality of 
instruction necessary for attainment of high student performance. Do teachers in high poverty 
schools earn less on the average than teachers in other schools in the district? 

Because teacher salaries vary considerably between school districts, it was necessary to 
adjustment for such differences before examining the impact of poverty. This was done by 
subtracting the district average from teacher salary figures at each school and then calculatmg 
the percent difference relative to the district average. 

Table 4c shows that the difference between teacher salaries at schools and thdr restive 
district averages were significantly, but minimally related to school poverty. Salaries in high 
poverty schools were about 2% less than the state average and about 3% less than m low 
poverty schools. Since pupil expenditures were greater in high poverty school, these results 
only clarify that those extra resources were not spent on more experienced or trained tcachere. 
This finding does not corroborate the substantial differences in teacher salanes found m the 
national study of Chapter 1 schools. 

As previously shown, high poverty schools tend to have more minority students. What about 
instructional staff? Do high poverty schools also tend to have more minority teachers? 

The data in Table 4c show that the proportion of minority tcachen in a school is somewhat 
dependent on its poverty Icvd. It can be seen that the percent of minority teachers was much 
hiSher than the state average and nearly double the figure for low poverty schools. As wdl, 
this variable had the second largest effect size of all twelve input variables examined. This 
finding can be partially explained by the fact that high poverty schools also tend to have large 
numbors of minority students. 

Siimmarynf Findings 

Dividing Florida elementary schools into low, medium and high poverty groups produces 
results in support of the premise that schools serving larger numbers of poor children operate 
at a significant disadvantage. Table 5 consolidates the information presented thus far and 
ranks those variables that arc most impacted by the poverty level of a school. 
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Table 5: Impact of School Poverty on Selected Data Base Variables 



Low 


Medium 


High 


Effect 


Poverty 


Poverty 


Poverty 


(n=353) 


(n=737) 


(n=368) 


Size 



Data Base Variable ( Grouf 

Student Achievement 

% Above National Median-Reading 
% Ahnvft National Median-Math 



64% 
70% 



% Ahnv ft State Standard-Writmj 

Schoo l Indicators 
Promotion Rate 
Attendance Rate 



28% 

97% 
95% 



49% 
56% 
19% 



25% 
37% 
9% 



.26 (L) 
.22 (L) 



.20 (L) 



Suspension Rate 



0.5% 



Srhnol Characteristics 



% Minority 



21% 



% Umited English Proficient (UEP) 
Mobility Rate 



1.4% 



25% 



Sc hool Inputs 



School Size 
Class Size (K-5) 
Support Staff (per 500 Students) 
"R eeular* Propram Expenditures (% + /-) 
General Fund Component (% +/-) 
Federal Fund Component (% 
% First Year Teach^ 



7^ 
25 

il 
-1% 
1% 
-79% 
4% 



96% 
94% 



91% 
94% 



1/?% \ 1.6% I .06(S) 



28% 



76% I .23 (L) 



0.6% 



35% 



4.8% 
44% 



.03 
.10 (M) 



6^ 

21 

il 
-1% 

-2% 

+ 25% 

4% 



632 

2L 

iL 
_+8% 

-1% 

+ 147% 

8% 

48% 



.05 (S) 

.q8_^ 

.23 (L) 
.05 (S) 
.03 



% Experienced Teachers (10 Yrs or More) 59% 



56% 



% nf Teachers with Advanced Degrees 



35% 



31% 



31% 



.02 
.04 



Average Teacher Salaries (% •<•/-) 



+ 1% 



+ 1% 



-2% 
28% 



% Minority Teachers 



14% 



13% 



.10 (M) 



Table 5 summarizes all of the data previously presented mto a smgly Asplay , so ^t/^aUve 
effect sizes can be seen for all data base variables. 3n the followmg diwussion symbols are 
S to^ignate large (■), medium (□), and small (□) effect sizes. Effect sizes below the 
minimum criterion are shown as (D). 
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The foUowing are data base variables that are the most affected by o^, "^^^^J^, 
JJve^ TLTcase the effect size associated with differences between low. medium, and 
high poverty schools was large. As school poverty increased: 



Reading achievement decreased. 
The percent of minority students increased. 
Federal (Chs^ter 1) expenditures increased, 
Math achievement decreased, and 
Writing performance decreased. 



Tlie following were at least moderately affected by or related to school poverty, (i.e.. effect 
sizes were clisified as medium). As school poverty mcreased: 



□ Student promotion rates declined. 

□ Attendance rates declined. 

□ Mobility rates increased, and 

□ The percent of minority tjachers increased. 

m following variables were also sigmficantty affected by or related to school poverty, though 
their effect sizes were smaller. As school poverty mcreased: 

□ "Regular" program expenditures increased. 
O Out-of-school suspensions increased, and 

O TTie number of support staff per 500 students mcreased. 

From these relationships, the following summary statements seem warranted: 

Hi£h poverty schools are characterized by low levels of student acMevement in the 
SS^g and math, as weU as Wgher order skilh re^^ 
Promotion and attendance rates are lower, suspension rates arc higher. 

High poverty schools tend to be characterized by relatively J«BJ.";;«^^ 

s^higher mobility rates. However, the premise that high poverty schools 
serve more limited English Profident students was not sustamed. 

No substantial impact was found with regard to the number of students inascl^l or c 
SL-Sze; howevihigh poverty schools did have considerably more support staff. 

Hioh oovertv schools have more, not less, monetary resources in comparison with 

iSXKmarily Chapter 1) and to a lesser extent for local and general revenue 
fimds. 
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HiEh poverty schools have more fust year teachers than is typicaUy found » -"e?™" 
mdl.SJZ^ schools. This trend is complemented by "wer numbers rftead^ 
tTftTl^S^ years' experience and sUghtly fewer teachers with »d«»l<»^*«^^ 
r^flXhigh poverty sdwols tend to have a greater pn^roon of mmont.es among 
thdr instnicfional staff , much lilte the student clientele they serve. 

Most of die findings regarding diffirrences between school inputs in h^ vmus low 
i^^^Sr^in leneraf agreement wiU. the r^J^muiooal study of Chapter 1 
Sources in the context of state and local resources for educattoo. 

Least this summary of findings paint too dismal a porttait '"^^^'''^^t'hS 
^ emphas^ l^nume™. ^ 

reading scores higher than ^f"^^*"^^^^.^^^ suspension rates. These findings 
great challenges they faced. 
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Section 3: 

Conditior.s Related to Student Achievement and Learning Environment in 

High Poverty Schools 

The puipose of this section of the Successful Schools pilot project report is to narrow the scope 
of the previous data base analysis so that the focus is on those schools that are of greatest 
interest to Chi^ter 1 program managers. Instead of looking at all 1,458 elementary schools in 
Florida, the context was limited to the subset of 368 schools classified as high poverty on the 
basis of having about 65 % or more of their students on Free or Reduced Price Lunch. Also, 
the study emphasis was shifted from the general impact of poverty to the more specific issue of 
conditions that affect students' achievement and their learning environment. Ckm iitformation 
from the Florida School reports identify conditions that promote higher achievement? 

Reading, math, and writing achievement, as wdl as promotion, attendance, and suspension 
rates for each of the 368 high poverty schools were categorized as being either above or below 
the median for all similarly situated schools. Data base variables that reflect student 
characteristics and school inputs were also categorized as being above or below the median for 
the high poverty school group. 

This enabled the construction of 2 X 2 contingency tables that show what happens to student 
outcomes when schools are above or below the median for a particular data base variable or 
condition. When there is no relationship with a particular viriable, one would expect higher 
levels of achievement or indicators of a positive learning environment to be somewhat 
randomly distributed Ci.c, about 50% on either side of the median). The extent to which the 
distribution of positive outcomes is different than 50/50 is considered evidence that there is, in 
fact, a relationship with the variable being examined. 

Table 6a provides a summary of the results for the first in a series of analyses of relationships 
between data base variables and school outcomes—in this case, reading achievement. As in the 
previous section, the analysis method was one of applying non-paiametric median tests to 
determine initial statistical significance. Chi-square values are shown, as wdl as the 
probability of chance or random occurrence. For each variable whose probability of chance 
occurrence was less than 1 in 100 (p< .01), effect size estimates were also calculated. From 
the standpoint of practical significance, effect sizes between .05 and .09 were considered small 
(S), .10 through .19 medium (M), and .20 and above large (L)'', as per Cohen (1988). 

Since the primary interest of program managers is usually with conditions related to increased 
achievement or a more favorable learning environment, analysis results were framed in that 
manner. Table 6a, like all others in this series, shows the percent of schools above the median 
outcome level when selected data base variables were lower and when they were higher than 
what was typical for high poverty schools in general. 




''In the discussion of results, the following symbols are used to designate large (■), 
medium (□), and small (□) effect sizes. D denotes marginal efftet sizes. 
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Table 6a: Readins Achievement in High Poverty Schools, 
When Selected Variables Were Lower or Higher 
Than the Group Median 





% of Schools 
Above Median 
Reading Level 
When: 




Data Base Variable 


Variable 
Was 
Lower 


Variable 
Was 
Higher 


Chi- 
Square 


P 


Effect 
Size 


% Minority 


76% 


21% 


101.6 


<.001 


.31 (L) 


% on Free or Reduced Lunch 


70% 


25% 


64.7 


<.001 


.20 (L) 


% Minority Teachers 


68% 


29% 


50.4 


<.001 


.15 (Nf) 


% of Avg "Federal" Expenditures 


68% 


29% 


49.1 


<.001 


.15 (Nf) 


Support Staff/SOO Students 


36% 


61% 


20.4 


<.001 


.06 (S) 


% Limited English Proficient 


60% 


37% 


17.5 


<.001 


.05 (S) 


Promotion Rate 


39% 


56% 


9.2 


.002 


.03 


% First Year Teachers 


58% 


41% 


8.8 


.003 


.03 


School Size 


57% 


41% 


8.2 


.004 


.03 



The data in Table 6a indicate that the percent of schools whose students scored above the 
median reading level for all high poverty schools increased when: 

■ The percent of minority students was iQSKfit 

■ Hie percent of students on Free or Reduced Price Lunch was )smi 

□ Hie percent of minority teachers in the school was lower 

□ Differences between school level and district average expenditures of federal 
(Chapter 1) funds wore smallcc 

□ The number of support staff (per 500 students) was bighci 

□ Thepercentof Limited English Proficient students was lorn 
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The relationships between reading achievement and the following data base variables were also 
statistically significant; however, their effect sizes were somewhat low: 

D School promotion rate, 

D Percentof first year teachers, and 

0 Number of students enrolled in the school. 

It is also important to note that the following variables were not significantly related to 
reading achievement in high poverty schools: 

BI Attendance rate, 
la Suspension rate, 
SI School mobility, 
SI Class size, 

SI "Regular" per pupil expenditure differences, 

SI The general fund component of "Regular" expenditures, 

SI Pocent of expnienced teachers in the school, 

SI Percentof teachers with advanced degrees, or 

S] Average teacher salaries at the school. 



Table 6b: Math Achievement in High Poverty Schools, 
When Selected Variables Were Lower or ffigher 
Than the Group Median 





% of Schools 
Above Median 
Math Level 
When: 






Data Base Variable 


Variable 
Was 
Lower 


Variable 
Was 
Higher 


Chi- 
Square 


P 


Effect 
Size 


% of Ave "Federal" Expenditures 


64% 


32% 


33.7 


<.001 


.10 (M) 


% on Free or Reduced Lunch 


62% 


33% 


26.0 


<.001 


.08 (S) 


% Minority 


60% 


36% 


18.5 


<.001 


.06 (S) 


% Minority Teachers 


57% 


39% 


10.8 


.001 


.03 


% of Ave "ReEular" Exoenditures 


56% 


40% 


7.8 


.005 


.03 


Suspension Rate 


56% 


40% 


7.6 


.006 


.02 
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The data in Table 6b suggest that math achievement in high poverty sch ols increased when: 



□ Differences between school level and district average expenditures of federal 
(Chapter 1) funds were smallsi 

□ The percent of students on Free or Reduced Price Lunch was lower 

□ The percent of minority students in the school was lower 

The rdationships between math achievement and the following data base variables were 
statistically significant; however, thdr effect sizes were lower than the standard used in this 
analysis: 

D Percent of minority teachers in the school, 

D Differences between school level and district average expenditures of "Regular" 
program funds, 

D Suspension rate, and 

No other database variables were significantly rdated to math achievement. 



Table 6c: Writing Achievement in High Poverty Schools, 
When Selected Variables Were Lower or Higher 
Than the Group Median 





% of Schools 
Above Median 
Writing Level 
When: 




Data Base Variable 


Variable 
Was 
Lower 


Variable 
Was 
Higher 


Chi- 
Square 


P 


Effect 
Size 


% on Free or Reduced Lunch 


63% 


36% 


25.1 


<.001 


.08 (S) 


% of Avs "Federal" Expenditures 


62% 


38% 


18.6 


<.001 


.06(8) 


% of Ave Teacher Salaries 


42% 


57% 


6.8 


.009 


.02 


% Minority 


57% 


43% 


6.8 


.009 


.02 



The data in Table 6c show that writing achievement in high poverty schools increased when: 

□ The percent of students on Free or Reduced Price Lunch was Iqjkcc 

□ Differences between school level and district average expenditures of federal 
(Chapter 1) funds were smalkr 
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In addition there were other variables which exhibited statisticaUy significant, but very smaU 
effect sizes: 



D Average teacher salary differences and 
D The percent minority students. 

No other data base variables exhibited significant relationships with writing achievement in 
high poverty schools. 

The following is a summary of relationships between selected data base variables and tihree 
indicators of school achievement-rcaxling, math and writing. The list of v^tes has been 
ordered on the basis of effect size and the number of achievement mdicators affected. 



Table 6d: Summary of Relationships Between Data Base Variables 
And School Achievement 



I Reading | Math I Writing I 



% on Free or Reduced Priced Lunch 


.20 (L) 


.08 (S) 


.08 (S) 1 


% of Ave "Federal" Expenditures 


.15 (M) 


.10 (M) 


.06 (S) 


% Minoritv Students 


.31(L) 


.06 (S) 


.02 


% Minority Teachers 


.15 (M) 


.03 




SuDDort Staff/SOO Students 


.06 (S) 






% Limited English Proficient 


.05 (S) 






% First Year Teachers 


.03 






% of District Average Teacher Salaries 






.02 


Promotion Rate . 


.03 






% of Avg "Regular" Expenditures 




.03 




Suspension Rate 




.02 




School Size 


.03 







Looking at the relationship of data base variables across achievement indicators, it would 
appear that the percent of students on Free or Reduced Price Lunch has one of the strongest set 
of relationships. This finding is particularly interesting since all of the schools in the analysis 
were already classified as high poverty. What this means is that the effect of increasmg 
poverty concentration does not level out; it remains a potent influence even in "high poverty" 
schools. While program managers have Utde control over school poverty, it is somethmg that 
should be brought to the attention of poUcy makers in charge of school zoning and transfers. 
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Another variable that stands out from the list of conditions that influence school achievement is 
federal expenditures, which had a moderately strong relationship with reading and math and a 
smaller one with writing. However, the direction of these relationships is opposite of what 
one might expect. As the difference between a school's expenditure of federal funds versus 
the district average increases, reading, math and writing achievement appear to decrease. 
These data have implications for Chapter 1 Schoolwide projects, where extra resources are 
concentrated in high poverty schools. Li Schoolwide projects, the difference between school 
expenditures and the district average is much greater than for other types of Chapter 1 delivery 
systems; however, the pattern of negative returns argues that money alone cannot overcome 
obstacles to improved achievement associated with large numbers of students from low-income 
families. Rather, this finding reinforces the necessity of efforts like the Successful Schools 
project which seeks to identify characteristics of high achieving, high poverty schools, 
establish viable technical assistance linkages with similar, but lower performing schools, and 
strengthen needs assessment and planning activities to support school improvement activities. 

The percent of minority students in a school was another variable that exhibfted a strong 
relationship with a variety of achievement indicators. A parallel variable, the percent of 
minority teachers in a school exhibited a moderate relationship with reading and a significant, 
but somewhat weaker relationship with math. 

Though all subject areas were not affected, it is noteworthy that the number of support staff 
per 500 students in a school appears to have a positive, though small, influence on reading 
achievement. As mentioned before, this is a variable that warrants extended investigation, 
because it is not clear fiom the Florida School Reports as to which kinds of support staff are 
involved in promoting achievement. 

From a different perspective, it was informative to examine those data base variables that were 
not related to any achievement outcome. Given uniformly high attendance rates as calculated 
in the Florida School Rqports, it was not surprising that this variable was not idated to higher 
achievement. On the other hand, it was surprising that the student mobility rate for a school 
was not significantly related to any of the three achievement indicators studied. The mobility 
rate reflects the extent to which a school serves a changing population and is often cited as a 
reason why achievement might be low at particular schools. It was also interesting that the 
general fund component of so called "Regular" expenditures did not show evidence of a 
significant relationship with any of the three achievement measures. (Just the opposite was 
true for federal expenditure differences.) Last, the fact that the percent of experienced 
teachers in a school was not significantly related to achievement outcomes among high poverty 
schools may be a natural extension of a similar finding in Section 2 that showed no substantial 
difference between low, medium and high schools. 
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tj>flniiny Environme nt 



The next series of tables feature data base variables that reflect on a school's learning 
environment. Included are promotion rate which indicates pupU progress, attendance rate 
which somewhat indicates opportunity to learn, and out-of-school suspension rate which often 
indicates the prevalence of serious behavioral infractions. 

Table 7a: Promotion Rates in High Poverty Schools, 
When Selected Variables Were Lower or Higher 
Than the Group Median 





% of Schools 
Above Median 
Promotion Rate 
When: 








Data Base Variable 


Variable 
Was 
lower 


Variable 
Was 
Higher 


Chi- 
Square 


P 


Effect 
Size 


% on Free or Reduced Lunch 


58% 


42% 


9.1 


.003 


.03 


% Teachers with Adv Decrees 


58% 


42% 


9.1 


.003 


.03 


% Minoritv Students 


58% 


42% 


9.1 


.003 


.03 



The data in Table 7a show that the following three data base variables were significantiy 
related to student promotion rates in high poverty schools; yet none were sufficientty strong to 
warrant even a small ei^ect size designation: 

D Percent of students on Free or Reduced Priced Lunch, 
0 Percent of teachers with advanced degrees, and 
0 Percent of minority students. 
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Table 7b: Attendance Rates in High Poverty Schools, 
When Selected Variables Were Lower or Higher 
Than the Group Median 





% of Schools 
Above Median 
Attendance Rate 
When: 








Variable 


Variable 


Chi- 




Effect 


Data Base Variable 


Was 


Was 


Square 


P 


Size 




Lower 


Higher 








School Mobility Rate 


58% 


38% 


14.9 


<.001 


.04 



The data in Table 7b show that the only data base variable that was significantly related to 
student attendance rates in high poverty schools was the school mobility rate; however the 
strength of this relationship was bdow the criteria for a small effect size: 



Table 7c: Suspension Rates in High Poverty Schools, 
When Selected Variables Were Lower or Higher 
Than the Group Median 





% of Schools 
Above Median 
Suspension Rate 
When: 




Data Base Variable 


Variable 
Was 
Lower 


Variable 
Was 
Higher 


Chi- 
Square 


P 


Effect 
Size 


School Mobility Rate 


41% 


58% 


9.8 


.002 


.03 


% of Ave "General" Exoenditures 


58% 


41% 


9.1 


.003 


.03 


% Limited Enelish Proficient 


57% 


42% 


7.9 


.005 


.02 


Attendance Rate 


57% 


42% 


7.9 


.005 


.02 
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The data in Table 7c show that the following four data base variables were significantly related 
to suspension rates in high poverty schools; yet effect sizes were minimal: 



Q School mobility rate, 

D General component of "Regular" expenditure differences, 

D Percent of Linjited English Proficient students, and 

D School attendance rate. 

Looking back on promotion, attendance and suspension data, it is important to note that there 
were no data base variables or conditions for which there were appreciable effect sizes. 



Summary an H ttl«aission 

The search for conditions that promote achievement in high poverty schools was more 
productive than the search for conditions that affect learning environment. In this regard, 
higher concentrations of students from low-income families were consistently associated with 
decreases in student achievement in all subject areas examined-reading, math and writing. 
While program managers may have Utfle control over this variable, it is something that should 
be brought to the attention of those who make decisions concerning school zoning and transfer 
policies. 

Another finding in this section questions the wisdom of concentrating federal resources in 
Chapter 1 Schoolwide Projects without comprehensive plans for improvement activities that 
will improve the entire instructional program. Currently, almost anything can be done with 
the extra federal funds that are provided to these projects. How are these extra resources 
coordinated with school improvement plans as required under Blueprint 2000? To what extent 
are Schoolwide projects based on the specific academic needs of students? How do 
Schoolwide projects enhance the delivery of technical assistance, staff development, and 
restructuring necessary to bring about improved student achievement? 

The number, type and training of support staff in a school is one of the few variables examined 
in this section that was associated with higher achievement and that can be directly influenced 
by program managers. However, the school report data do not provide suffident information 
to act. Extensive follow-up is needed in this area. 
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Section 4: Against AU Odds: Succestful, High Poverty Schools 



Section 4 of the interim report on Florida's Successful Schools project represents yet another 
narrowing of research perspective, down from all high poverty elementary schools (n=368) to 
a smaller subset of those schools (n=58) that represent the extreme ends of an achievement 
continuum-highest achieving versus lowest achieving. The purpose here is to capitalize on a 
spin-off of the research reported in Section 2 regarding the impact of poverty on Florida's 
dementary schools. 

During the course of comparing student achievement among high, medium and low poverty 
schools, it was found that some high poverty schools actually did quite wdl, despite 
overwhelming odds against them. For example, it was pointed out that 60 (or 16%) of the 
state's high poverty schools had reading scores above the statewide median for all elementary 
schools, 75 (or 20%) had higher math scores, and 41 (or 11%) showed evidence of better 
writing achievement. 

In order to follow up on these encouraging findings, high poverty schools which exceeded 
overall state medians in at least two out of three outcomes categories (reading, math, or 
writing) were identified for further study. The result was a group of 29 schools, located in 20 
of the 67 districts), whose students did better than most other schools, even though their high 
poverty status would predict the opposite. While exceeding the state average may not 
accomplish the very highest goals envisioned by Blueprint 2000, it is, nevertheless, a 
remarkable accomplishment. Accordingly, these schools can be classified as "successful" as 
compared to all other high poverty schools. 

By way of contrast, lower achieving schools were defined as ones which fell below the median 
for all high poverty schools on at least two out of three subject areas. On this basis there were 
a total of 160 schools (43% of all those classified as high poverty) that would appear to need 
extra assistance. However, in order to have equal size groups and to present the sharpest 
contrast against "successful" schools, only 29 of the lowest achieving were subsequenfly 
identified for inclusion in a "comparison" group of schools. 

The combined study group for this section of the report consisted of 58 out of 368 (or 16%) of 
those schools which had the highest concentrations of students from low income femilies, 
based on the percent on Free or Reduced Price Lunch in the 1992-93 Horida School Reports. 
In this group of 58 schools, the median percent of students on Free or Reduced Price Lunch 
was 80%, which is above the eligibility cutoff (75%) for Chapter 1 Schoolwide projects. 
Incidentally, seventeen of the 58 contrasting schools (35%) actually were operating a 
Schoolwide project at the time of the study; of these, only three were in the successful school 
group. There were fourteen Schoolwide Projects in the comparison group of schools. 
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m fonowing daa Ubles are organized to ""'^,'«f=«'S^*?7ri «8)'^^^ 
hi.h naveitv schools, relative to all elementary schools in Honda (n- 1,458). in ne^uig win 
ftfoSS-Tof toe pUot project, emphasis was placed on chanK^terisUcs of successfi.lh.gh 
^^^t^. l^la ftom thi comparison group of lower achieving schools was used to 
accentuate the differences. 

Table 8: Successful vs Comparison Schools: 
Student Achievement, Related Indicators and Student Characteristics 



Reading 



Math 



Writing 



] 



fltudtmt Achievement 



All Hementary Schools (n^g 1,458) 



47% 



54% 



18% 



29 Successful, Wif^h Poverty Schools 



50% 

7% 



61% 

16% 



20% 
3% 



29 Compariso n ^ High Pover ty Schools 



. students in tiie 29 high achieving, Mgh poverty schools scoi^dlu^crtim 
state^de medians in aU subject areas-icading, matii, and wntmg. Studente m toe 29 
comparison schools scored dnunaticaUy lower than students m successful schools, 
nie two groups of high poverty schools appear to be worlds apart witii regard to 
student achievement. 

Table 8 (Continued) 



Promotion 



Attendance Suspendon 



Related Indicators 



All HementarY Schools faa: 1,458) 



95% 



94% 



1.1% 



29 Successful. High Poverty Schools 



91% 



94% 

92% 



1^% 



29 Comparison. High Poverty Schools 



88% 



4.4% 



• Differences on variables that reflect on a school's learning environment were not 
nearly as pronounced as those that dealt directiy mi» achievement. Promotion and 
attendance rates in succcssfiil schools were lower tium overall state figures; suspension 
rates were about the same. However, in contrast with comparison schools, the more 
successful group fered better on all indicators of learning environment, especially 
suq>enslon rates. 
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Table 8 (Continued) 



%Poor 


Minority 


L.E.P. 1 


MobiUty j 




. Suc^ssM high p»ve«y schools had j«o^c^y, »»« ndn^^r — 

nucl 

, » ^;ffi.rMi« between successful and comparison schools with 
There was almost no difference between 5ucw»»iui r- 



Table 9: Successful vs Comparison Schools: 
School Inputs 





Class 


School 


Size 


Size 


(K.5) 


685 
566 


24 


752 


25 



Number of 
Support 
Staff 



XrJuMl Inputs 
All Hementary s^^Qols (n=" 1,458 

IQ Succcssful i wtf[^ Poverty Schools 
-? o romoarison. w^ff^ PQv«tv Schools 

. successful schools tended to be about 100 students ^ert^ 
almS smaller than the median for comparison schools. 

. ciass-sizesinhigh achieving schools weredigh^^^^^^ 
schools, which had about the same as the statewide figure. 

^ w« H5ff^T*n« in rdative numbers of support staff that favored high 
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Table 9: (Continued) 




,miitw»>^"' — 

Wei and district averages, per 
comparison schools. 

Table 9 (Continued) 




»f emerienced teachers flian comparison 
. SuccessMschooUhad.la.^^^S'^^X^medi'"*'''"'^'?^ 

high achieving schools. 

. T.e^e»«be««en.ve»geuj^^^ 
groups of schools. 

. SuccessMschooU-^^^e^^^tt^^ 
their staff as the stote median, but less tnan one- 
comparison schools. 
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Summary a nd iTPpHpations 



First, there is compelling evidence in the Florida School Reports that some high poverty 
schools do extremely well at promoting high levels of student achievement. On the other hand 
there is a relatively large number of high poverty schools that were not doing well and some 
that were in dire need of improvement. 

Successful and comparison school groups were not distinguishable on such measures as 
promotion and attendance rates, percent of LEP students, mobUity, class size, "regular" 
program expenditures, or teachers with advanced degrees. However, successful schools were 
clearly distinguished from their lower achieving comparison group by having fewer minority 
students and teachers, more support staff and lower suspension rates. Also, successful schools 
were somewhat distinguished from comparison schools by smaller numbers of students on Free 
or Reduced Price Lunch, smaller total number of students, more general funds/fewer federal 
funds, fewer first year teachers/more experienced teachers, and higher teacher salaries. 

Beyond illustrating that some high poverty schools have beaten the odds against relatively high 
achievement, the question arises: To what extern could the 29 successful schools serve as 
models and/or technical assistance providers to lower achieving schools? 

With regard to the 29 low achieving schools highlighted in this section, there are but a few 
successful schools which are comparable in terms of demographic characteristics. Only seven 
successful schools had concentrations of poor students above the median for all high poverty 
schools; only six were above the high poverty median for percent of minority students; and 
just five schools were above on both demographic features. However, these five schools 
might serve as lole models and/or technical assistance providers to even the lowest achieving, 
high poverty schools. 

Likely, there would be an additional number of successful schools which would be 
demogiaphically comparable to many of the remainder of the 160 that were bdow the median 
achievement levels of two out of three subjea areas for all high poverty schools. Hiis is an 
area that warrants further investigation and feasibiliQr testing. 

Considering all results presented so far, it would appear that data base variables alone do not 
provide school personnel or program managers sufficient information to make constructive 
changes. The data from school reports are valuable in terms of reflecting achievement and 
learning environment conditions in schools, but do not indicate what to do to promote better 
conditions or point to specific features of "successful" schools that make them so. 
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Section 5: 

Data Base Profiles of Schools that Participated in the Pilot Phase 
of Florida's Chapter 1 Succes^ul Schools Project 

niis part of the Successful Schools interim report represents the final narrowing of rwcarch 
oSsi^ctive in the series of data base explorations into charactenstics that distinguish high 
Skg, high poverty schools. The focus now is on sixteen schools that were selected for 
Ae p^se of Md-testing survey instruments and on-site observaUon procedures. The pUot 
pi^Sools were loca^ across the state, from the northwest Panhandle to south Honda 
Xlre su~^^ to represent a broad cross-section of all high poverty schools in the state. 

The process for selecting pUot schools began with an analysis of "^^"8 
ChJer 1 students in grades 2 and above over the previous two years By d«ign, the uut^ 
pod of potential study schools consisted of relatively equal numbers of high and low actacvmg 
Ss S^ut 30 in Lh category), all of which had at least 75% of their students on Free or 
Reduced Price Lunch and were therefore eUgible for Chapter 1 Schoolwide projects. 

Next, the Ust of potential study schools was examined in terms of characteristics that would be 
smpiipriate for the pilot (e.g., continuity of administration, student membership etc.). 
Rnally the list was narrowed to schools that were in the study committee s own distncts m 
the hopes of expediting communication and participation. In the end, a broad mixture of 
schoolswas included in the pUot study, some of which mcsacd to be clearly successful m 
terms of raising the achievement level of Chapter 1 students, some of which had been 
identified for program improvement; some were rural, urban, suburban; and some laA large 
concentrations of migrant and/or LEP students. This was a deUbcrate sample, chosen to 
maximize differences between higher and lower achieving schools, all of which had large 
concentrations of students from low income families. 

nie purpose of this section of the report is to compare data from the 16 schools chosen for the 
pUot study against all high poverty schools in the state (n«368), the latter having been shown 
to be generally characterized by student achievement that is significantly lower than observed 
in the general population. EssentiaUy the research question was; How do the two groins of 
pilot project schools fare on the same variables that were used to profile the larger set of high 
poverty schools in the state? 

In the summary tables which follow, data from pilot projea schools were consoUdated into 
two groups of eight schools each, based on a composite ranldngS ©f student outcomes and 
related indicators. TTie eight schools included in Group "A" represent higher achiwing 
schools. Group "B" represents lower achieving schools. The summary tables providemedians 
for 21 data base variables for the higher versus lower performing groups of schools-both to be 
viewed in relation to the median for all high poverty schools in the state. Date base variables 
have been organized into clusters representing student achievement, learning environment, 
school characteristics and school inputs. Data for individual schools arc included in an 
appendix to this section of the report. 



8 H«lght«d aun of noramll««d ranks, con«l«tlng of r«adlng+math+wrltlng 
( doubled ), plus pro«otlon+att«nd«nc«+«u«p«n«lon. 
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Table 10a provides an overall summary of contrasts between group "A" and "B" schools on 
variables that reflect aggregate student achievement in reading, math and writing for fourth 
grade students in the state. 



Table 10a: Summary of Student Achievement Variables 
For Two Groups of Pilot Project Schools 



PUot 


Referaice- 


Pilot 


Group "A" 


AUHigh 


Group "B" 


Schools 


Pover^ 


Schools 


(n=8) 


(n«368) 


(n=8) 



Data Base Variables 

Student Achievement 








% Above National Median-Reading 


33% 


25% 


14% 


% Above National Median-Math 


45% 


37% 


27% 


% Above State Standard-Writing 


13% 


9% 


5% 



At the outset, it should be noted that two of the schools in group "A" were among the 29 high 
performing, high poverty schools identified in an carUer section of this r^rt; two in group 
"B" were among the 29 lowest performing schools in the state. Hus hsqjpened coinddentally, 
and was not part of the original design; however, thdr inclusion helps to reinforce that the 
intended polarization between higher and lower achieveing schools in the pilot project did 
occur. 

• Schools in group "A" were clearly above thdr counterparts in group "B" in terms of 
student achievement in reading, math, and writing. 

• Median achievement levds fcr group "A" schools were above the medians for high 
poverty schools in general ia all subject areas considered. Just the opposite vm true 
for schools in group "B" ; median achievement levds were bdow that of all high 
poverty schools in the state in all subject areas. 

• The magnitude of differences between group "A" versus "B" schools are notable. 
The median percent of students in group "A" schools who scored above national 
averages in reading was over twice that of group "B" schools. In terms of writing 
performance, group "A" schools outperformed group "B" by nearly three to one on 
the Florida Writes! assessment. 

• These data substantiate that the originally intended design behind the sdection of 
schools for the pilot project was met. 
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^ conu^st of pilot school groups, but «i.h v^iables .ha. 




* »ii novertv schools on two out of 

in^catois. 

— .«a«e.e«cesl«t.e«.a»tch,»cte.s«cs.pUo.p^^ 
gioup "A* versus "B". 

Tabic 10c: Summary of Studait Cha^^ 
For Two Groups of Pilot Project Schools 




35 



5^Sci-isU.cebyc««.ple. 

nroblcm in future linkage efforts. 

. «f mWtv and UEP students, schools in group 
. Despitehavinglowerij^^^^^^ 
-A" had higher mobility rates. 



Alllffigh 



Pilot 
Group "B" 
Schools 

fn«8) 
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^^^^^''^'^^ u 1 . .rouo-A-wasaboutaSOsmallerthan 

The median student membership for schools in group A wasabo 

l^g^^B^ class size was also lower. 
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« "3" W3S in the 

« ivtwcen schools in group "A" v«sus 

group "A" schools was 

schools. ^ "Regular" expenditure 

schools spent less. ^ ^^hools in 

groups were considerably aoo 

^ teachers, the m«fc»n for schools 
* -^.Tnerienced (first year) teachers, u , ^^^^j^^j^^ 

««»*^<''^!f«^S»« than schools in group B . 

,^,a«os.«.»-«- ^,,ew««^ 
. In«r«ti.gly.b^^M^po«rty schools in generf. 
^ advanced aegW^O"" s- i~ „_ experienced teachas among 

^to«*en«l«».for'>'8hP» >„. 10« fewer ntori« «ch«. *» 

, • -«.,m-A"hadaboutlO*teww « ^^^ ^^^j jgljoois 

. Proprofio»«ly.«*»^"^,^^^ 
typicaUy found in high povwvj 

;« smtiD "B". 
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. . vffective School Components 

...^^tion process for the 16 
^.™«meofctaiacteristtcsaM»e»^7 'l^p^ett. This 
The previous section Pfff*^ P^ ^ 't^S^Tworr^ti™ 

section <lescr*« ^fective schools »J'^l?Sa„d is reported. 

Atechmcai ^D.»elopme»t. anaProce-f 

Conceptual Backgroima. Questtonn irfomuifion that presented 

^ success^ Sch«,ls S^-r.^tT^f "S..^^ ^rsch^" 

of E««5«^^^)'?Sition of ah. toSbuted over aU 
sub-conuni^^ ,^.d ov« mn* » 

,,^e,..theconceptof«hatn^ 
a school successful. adopted the seven corrc^ Eacpcctations. 

Effective Schools Comlates. 
Improvement 

1 Clear School Mission (CSM) ^^^^^^^ 

. , h.ve Clearly aiticul««l »«^'^^*^^^e«ts are to 

Effective schools have oif"/ ^ expectations, eicplam *7.{^ point for 
Missi»?^»;^Ss Tol^ffcctiveinj^^^ 



Frequent Momtoring (FM) effectiveness of school 

programs. T*^"^? mo«tcrv of course content. ™r!r!^«sarv. Staff in effccUve 
^school objectives wd^t^^ ^^^ ^hool's 
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safe and Orderly Learning Environment (SOE) 

eff^vc schools. U« sch<». <^^j^X:^i1^'^^^^ 
punwseM activities that a« ton>«.e«lattd. A prom^ ^^^^ 

SXh a «hool*ide disdptoe c^. mutiny a^ y^„, ^ 

parents. The discipline code "«*»'^„2^»!nttyby slaif and admimstraflon. 
Sq«ncesfornnsbehavioiand «^^c^^''y ^ 

TlodSts are given ieg»l» f^^^^^ to addition U. positive discipline 

encouragement and support ''XX^sS^Smpu^ is attractive and wett-kept by 

poUcies, effective »'«»'»r^^.S^e *Wt permeates tt« school, and extensive 

Su^Se « gi^S^^^" 
High Expectations (HE) 

research in effective schools ^^^^ S ^rac^»"'» 
^nstrates d«t aU students 'f^^'^^l^^^ studS.ts to achieve such 
higher. Teachers l«lieve flat rt« ll»r^^^« ^^3^,5^ 

The school is p^'??^ "^'^^Ccurriculum. An effective school 
leamti^basicandessentalAtils^n^^ 

uses heterogeneous groupings. <to«> >»T«^ paring flie mtended 

gr^ps. and team ^^^Tc^^^^ »" "^^T' 
curriculum. S«.dents and staff reguMy caeo^ aaembUes, and ott«r pubUc 

S^led^nrn t>m^*'« ^. "'^'^ 
activities, governance, and service. 

Opportunity to Learn and Time on Task (OTL) 

Time is a critical resource in the learning P-^X^S'^"^'^^^^ 

Iffidently through weU^iesigned ch^m ^^gj^ ^ 

learning activities. Adequate Ume is ^oc^tedforw^ 

in readtag, language arts, and math ^^^^''^^^J^^ develop critical thinking 

basic skms instruction into other content a^ m ^ ^ ^de students 

on assignments. 
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Instructional Leadership (IL) 

cutiiculum and inslrucuon, and Aey are aDB » ^ 

aaff numbers in leaderdup ''""J^* PJ^'^oT^Sf.^^ . »»1 »»dents. 

in communicating the msaon »^8^^*',f'^ 'aSd prognuns tteough 

Tie principal ^f^\^^,^of c^J. ^ 

inteiptetation of test results ami ^ school's instructional time, 

sets high "pe^aa^ f« ^ £ of^g l«ming. Effective 
and engages the "^.^^^^^^ members to improve the instructK,^ 
J^'JTs^X Si-t are provuled for staff 

growth and devdopment. 
Home-School-Community Relations (HSR) 

^ effective schoc.s.par»tsa.^ d;e»^-^;^^ 
purpose of the school. The school creatK ™^ "J^Tl ,^1001 Ws frequent and 
STchildren's leaning >»* " i^f'ijeSL cTurse conTt, student 

multiple methods "f for teachers and parents to 
ptogress. and school programs. ^J",°S^^gs about the curriculum 
me^ether at parent-teacher "f "^ZlS^ is extended and home 

^ ,0 work «°S«««^»^'™SS^^»JS>«' """^^ 
and school are connected throu^ "^^Tl^dmL 4rent education programs of 
Pa^u are pnmded «ith thdr time and talents to 

their choosing. Community members are acm^ to OM^ ^^^^^ 

fte school imd community. imiV »y both the 

improvement planning. 

Questiomtaires the Com>eo^. '^^rfTL^^'oS'^^l^ 
Sblic SchooU were viev«d '^^^'''^^^^^TLI r,>,6ai»x focus of Horida's 
reviewed as a starting potot »f . ■"^'JJ^^^ KTcorrelate, aKl a 23 
schools. A 117 item school staff quMtt^ th^r^^J^^ ^ ^ 

item parent survey that o«^ rcp^ ^Sl^ s»"«y» "^"^ ^ 

^»d^e^"^J^^^^— 

T^iepaotproiectschoolsw^-^--^^ 

ai^aict took the staff questumnanes to 'T'^^ , school were targeted to 



returned for analysis. 
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tor de^ribing high ^ ^« ^ high and low 

prelintoiy consideration was jj^^ effective school components were 

5«forming schools, or whete fi>»^5"SsSally significant differences between all 

. ^rinTto"t^^Si»- detectable differences, a 

. «c concern --''nt:^'::?"^:^™^^ "^-^ 

Tteefore. a two-pronged ^^cS^u. exannne how weU survey results 

achievement data were used as » Sfwis viewed as a measure of predictive 

^^nded with achievement "7™f,,J^*'^^for excessive amounts of "not 
U conjunction to "^jKcS^^^^V" i»n» for those that were 
S^'^:r;;rpStS?e^.L.4ebeinsre^rted. 

^U,ersub-com„a.tee.oo.d««^U^ 

questionnaire items that could be dimmated. Atim co^ ^^^^ ^^.^ ^ 

ScTr^^lLm ^oLT (fTcoTy -^"'p'^ - '^"""^ 

Sates of rdiabiiity and predicdve vaUdity: 

Table 12: internal ReHabiUty and Predicdve VaUdity of Effective School Components 



ri«.r School Mis sion: 9 Items 

l^Tmirnt_t'-^*-"ff Student Progress; 5 Items, 
-j^^fe^;dOr <.riy Environment: 13 Items 
uiprh Fy pectations: U Items 
rirtiinit y to Learn: 12 Items. 

T^stnictionallA a'^'^^^P' 11 Items 

T>,iorinn.hips: 13 Items 

Total: 74 Items 

^ en. res^t of piloting the eff.U.e ^-^Tr^^-^:^ 
S^e;^'trr^rirpSoS&U. ThefoUgres..sf.msch<»ls.aff 

were based on the 74 item questionnaire. 



pilot project •chool*. 
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Table 13: Results of the Staff Questionnaire 




(* All differences between means were statistically significant; p< .001) 



hv the two groupings of higher and lower performing 
Staff results were analyzed by the wo group g b significant 

school components. 

^^ml: r ^TX^ ^en co^poncn. ^ be.w«n m 
and low performing schools. 

abuse by Other students. In addition, staff reported that mey oo icci 
hours. 

tUid most sipdiUant component mtenra of eSiW size oetwera t 
peifonning schools. 

^ fouowin, xesults for each of the 16 schools - JSLT^e^pS^t'^se'!^ Tz 
SSorf items mthin each component to produce seven score ranges. 
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Table 14: Score Ranges 





Sterns 


Score Range 


Clear School Mission 


9 


-14 to +18 


Frequent Monitoring 


5 


-9 to +10 


Safe and Orderly Environment 


13 


-26 to +26 


High Expectations 


11 


-15 to +22 


Opportunity to Learn 


12 


-17 to +24 


Instructional Leadership 


11 


-22 to +22 


Home School Rdationship 


13 


-26 to +26 


Total Effective School Score 


74 


-121 to +148 



As the component total score approached the upper/positive range of values, it signilKed that 
staff agreed that this component was present in their school. Conversely, as the component 
total score approached the lower/negative range of values, it indicated that staff disagreed that 
a component was present in their school. A score that was around 0 indicated that staff as a 
group had no predominate perception about the component. 

Results for each of the 16 schools across the seven effective school components were as 
follows: 



Table IS: Effective School Component Scores for the 16 Pilot Schools 



School 


CSM 


FM 


SOE 


m 1 OTL 


IL 


HSR 


Total 


A 


13.03 


6.66 


14.40 


15.03 


15.53 


14.12 


10.66 


89.38 


B 


13.79 


6.21 


14.63 


14.58 


16.37 


14.49 


9.89 


89.80 


C 


13.30 


6.92 


15.76 


14.74 


15.68 


17.00 


12.09 


98.19 


D 


9.96 


4.07 


8.44 


8.77 


11.52 


9.30 


6.62 


54.89 


£ 


10.48 


4.84 


16.48 


12.17 


12.91 


13.23 


6.51 


76.00 


F 


10.73 


4.65 


12.62 


10.94 


11.74 


12.25 


7.96 


73.75 


G 


12.80 


7.40 


16.20 


14.60 


15.80 


17.60 


4.30 


88.70 


H 


11.10 


5.40 


13.00 


11.87 


11.91 


11.67 


10.51 


75.89 




















I 


9.09 


4.26 


-3.65 


8.14 


10.17 


5.97 


1.77 


39.33 


J 


12.83 


6.88 


12.40 


13.47 


14.51 


15.85 


11.58 


88.43 


K 


9.07 


3.50 


6.07 


9.57 


12.39 


5.19 


4.30 


51.48 


L 


7.49 


3.47 


-7.65 


4.67 


7.75 


.12 


-2.77 


13.57 


M 


10.13 


4.22 


11.49 


10.93 


10.29 


8.86 


6.89 


62.89 


N 


4.93 


2.50 


-1.96 


5.33 


7.55 


4.31 


3.01 


24.69 


O 


8.71 


4.00 


-1.73 


6.94 


10.47 


7.48 


1.43 


41.09 


P 


10.16 


4.80 


-.08 


7.66 


8.80 


7.96 


5.89 


46.47 
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Results A-H were for high performing schools and I-P were for low P|;rfo5»«ing 
Sik ConSig these two groupings in general, total scores were similar m Ae 
^7eof vSSough schools D, 5, and M do not fit weU into the ^f-^^^ 
Sd^tors that divided schools into high and low performance w«e from a (hffera^^ 
^h^r^LH^antiie staff qucstiomiaire results. There may be changes m what was 
mSrS^y tS^ effective Lool components so that some schools were not fittmg as 
weU into a category that was based on prior performance. 

Prior reported results showed that the Safe and Orderly Environment compon^t 
^^^ti^ s«)ngest difference between high and low pcrformmg schools. 
SS^g te ST of scores for this component, differences ^-^J^.^^ 
^Ss of schools can be observed. With a component score range of -26 to +26, it 
Z XL scores for schools A-H and I-Pj^ different AKhough schools 
anH M do not fit weU into the pattern, scores A-H are higher UuOi scores I-J. Scores 
fof^h^ls I l!n, O and P p'Lented negative values. Tlie score for school P was 

close to 0. 

nf the staff Siimv Co mpniTfl to the Farem Sumv 

When the staff survey was originally developed as a 117 item <l'f ^"T;^' f 
Relationship component was refocuscd into a parwit survey. A 

fr^Tthe st^ surWy were rewritten to ask parents for th<^ percq)Uons In add^ti^ to ta^g 
versions oHhe parent survey, they were translated mto Spamdi ^^Ku^ Cr«^ to 
aS)mmodate the cultural diversity of some pilot schools. Most schods distnbuted the survey 
to a sample of parents although several school-wide distnbutions occurred. 

school groups and for each of the 16 schools individually. 

An analysis of the Kuent-staff results for the two general grou^gs of high and low 
J^otS^^ scl,t foC^Sca^^ significant differences (P-<:«»J) 
Stp«rceptions of the home/school relationship. Parent ratmgs m both toe high and ^ 
S'^eihools were higher than staff ratings. In the high performmg sdiools, there ^ 
^'^m^tJ:^^ L and parents in their ratings, ^^^^e ^ P«^rmii^^^^^^ 
Aere vm a greater discrepancy or difference between parent and staff »tings. To put the 
S^rmrm aJ^wpe^ve, parent ratings were at a similar level across the high «id low 
^S^ui^ Sis, h^cr, the staff ratings were lower at the lower performmg 
schools than at the higher performing schools. 

Parents from both the high and low performing schools rated every survey item, exc^t one, 
Sr t^ steT Staff from both the high and low performing schools rated the foUowmg 
item higher than parents: 
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Beyond report cards, teachers use other ways of communicating student progress to 
parents (e.g., conferences, home visits, phone calls, newsletters, and notes). 

School staff as a group were more positive that various ways of communicating to parents 
were occurring than the parents. 

Results were analyzed for each of the pilot schools to compare parent ratings with ratings 
given by the school staff. Results are for items that have a one-to-one correspondence, or are 
identical, on both the staff and parent surveys. The total scores could range from -40 to +40. 

Table: 16: Comparison of Parent and School Staff Ratings for Home/School Rdationship 



School 


Parents 


Staff 




School 


Parents 


Staff 


A 


22.31 


15.03 




I 


17.21 


4.38 


B 


19.71 


15.37 




J 


21.88 


17.67 


C 


23.92 


16.86 




K 


17.27 


4.77 


D 


21.93 


10.09 




L 


17.25 


-2.03 


E 


16.66 


9.18 




M 


22.28 


11.11 


F 


16.93 


10.43 




N 


25.43 


5.82 


G 




6.27 




O 


18.46 


2.50 


H 


22.87 


15.52 




P 




10.38 



Parents whose children attend either a high (A-H) or low (I-P) performing school rate 
the home/school relationship higher, or more positively, than staff do. 

In the results from high performing and low performing schools, differences between 
parent and staff ratings were statistically significant from 14 of the pilot schools. Since 
five or fewer parent surveys could be included from schools G and P, average ratings 
were not reported. 

Comparing the parent-staff ratings for the two groups of schools, the average difference 
between parent and staff total ratings was smaller for high performing schools than for 
low performing schools. The average difference between parent and staff ratings from 
schools A-H was 8.64. The same figure from schools I-J was 16.01. The parent and 
staff percqptions of the home/school relationship in the high performing schools were 
more in agreement than at low performing schools. 
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Section 7: Successful Schools Staff Survey, Technical Report 

The purpose of this section is to provide technical documentation^^ foj. the Chapter 1 
Successful Schools Staff Survey. 

Neutral Responses 

From the outset of the development effort there were concerns expressed that the survey had 
too many items and that school staff would not seriously respond if they faced too many 
questions. In fact there emerged from the development team the general feeling that the 
instrument ought be pared down by about one third. In order to substantiate this perception, 
an estimate was made of the impact of survey length on re^ndent tendency to be neutral or 
sldp survey items. This was done by simply correlating item numbers (1-117) with the percent 
of re^nses receded as "Don't Know" or missing. A significant correlation (.37 at p=.001) 
was found, thus confirming the initial suspicion that the sheer length of the original survey 
used during field-testing could have an adverse effect on the validity of responses. However, 
the percent of respondents who answered "Don't Know" or skipped a particular item ranged 
from none (questions 29, 36, and 37) to over 40% (question 18), thereby suggesting more of a 
selective problem with individual items, rather than a systematic problem affecting the entire 
survey. 

It is likely that the tendency toward respondent uncertainty is a function of many factors, not 
the least of which is ambiguous wording. Other factors that might influence neutral responses 
have to do with differences in respondents' bacl^round. The latter was explored by using a 
composite of rJi items in the original survey. The following trends were observed: 

• Those without a college degree showed significantly more neutrality in their responses 
(19%) than did respondents who had at least a Bachelors (12%). Advanced degrees did not 
affect this response tendency. 

* 

• The percent of neutral responses was significantly and inversely related to both years 
of total educational experience and years of experience at their school. Those with less 
than one year of total experience and those with less than three years at their school 
responded neutrally about 18% overall compared to 13% or less in all other groups. 

• Teachers were much more sure of their responses (12% neutral responses) than 
paraprofessionals (19%) or others (16%). Among teachers, those assigned regular 
classroom duties had the lowest overall amount of neutral responses (10%) of any other 
group (e.g.. Chapter 1 teachers-16%. Special teachers-18%, and Excq)tional Ed 
teachers-20%). 



Th« taxt for this •action was adaptad from a msmo on th« sam* 
datad 7/1/94. 
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• There was no significant difference in the percent of neutral responses attributable to 
respondents' racial/ethnic classification. 

These results suggest somewhat predictable trends in neutral responding and none of the 
figures associated with respondent background approach the very high rates associated with 
particular items. As a general recommendation, the percent neutral or missing should be 
monitored for items, and only those few items with 30% or greater neutral responses should be 
removed automatically. These are items for which at least one ou'. of three respondents did not 
understand the question or did not have a clear opinion. Included are questions 18, 42, S3, 
86, 87, 114, and 117. 

Calibration Sample 

While the percent of neutral or missing responses should be given some consideration, this 
does not provide the most useful information for choosing the best items. Rather, an item's 
relationship (correlation) with student achievement outcomes ought to be given much greater 
weight. This is necessary in order to use the staff surv^ and its results for the purpose of 
distinguishing between high versus low performing schools in terms of thdr effective school 
attributes and is a reflection on the instrument's predictive validity. School achievement in 
this analysis was represented by a composite of reading, writing and math achievement. 

The strategy for recommending which items to keep and which items to cuU from the Md-test 
instrument involved the use of a smaller calibration sample, instead of responses from all of 
the pilot schools. This was done to establish an analysis context that would msudmize the 
potential contrast between high versus low performing schools. The calibration sample was 
used to calculate item correlations for the purpose of selecting items with the strongest 
relationship to student outcomes. Four schools from each end of the achievement spectrum 
were chosen for a total of eight in all. High performing schools in the calibration sample 
included schools A, B, C, and D. Low performing schools included M, N, O, and P. Also, 
responses made by staff who indicated they had less than one year of total experience were 
excluded. By focusing just on these eight schools versus all 16, there was an immediate 
improvement in overall correlation with student achievement from .33 to .49, even before any 
items were identified for possible exclusion. 

In the tables which foUow, item numbers, item correlations, and two alternative versions are 
shown ("X" denotes items recommended for deletion by the surv^ work group who met in 
Sanibd in July). In general. Version 1 accomplishes the goal of reducing the original survey 
by about one third. This was done by group consensus with consideration given to eliminating 
items with non-significant (p>.OS) correlations and those with 30% or greater neutral 
responses. The second possible version represents an even greater reduction of items where 
tiie goal was to have just 35 items, seven for each subscale. At the end of each table are 
reliability estimates for the original and recommended revisions one and two. Ultimately, 
Version 1 was recommended for future survey administrations. Cronbach's alpha was used to 
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estimate reliability. For all analyses, the number of respondents from the eight schools was 
386. 

Table 17a: Item and Subscale Correlations with Student Achievement 

School Mission 



Item 


Correlation 


Version 1 


Version 2 


Number 








0 1 


.32 


ok 


ok 


0 2 


.30 


ok 


ok 


0 3 


.24 


ok 


X 


0 4 


.25 


ok 


ok 


0 5 


.14(n.s.) 


X 


X 


Q 6 


.25 


ok 


X 


0 7 


.21 


ok 


X 


0 8 


.24 


ok 


X 


0 9 


.20 


ok 


X 


010 


.26 


ok 


ok 


oil 


.12(n.s.) 


X 


X 


Subscale 








Correlation 


.35 


.42 


39 




Items 


11 


9 


5 


Reliability 


.89 


.87 


.77 



Table 17b: Item and Subscale Correlations with Student Achievement 
Monitorins Student Progress 



Item 
Number 


Correlation 


Version 1 


Version 2 


013 


.26 


ok 


ok 


014 


.27 


ok 


ok 


015 


.24 


ok 


ok 


016 


.20 


ok 


ok 


017 


.21 


ok 


ok 


018 


.23 


X 


X 


Subscale 
Correlation 


.32 


.36 


.30 




Items 


6 


5 


5 


Reliability 


.83 


.84 


.84 



(Note: Q 18 recommended for deletion due to percent of neutral responsess41 %.) 
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Table 17c: Item and Subscale Correlations with Student Achievement 
Safe and Orderly Environment 



Item 
Number 


Correlation 


Version 1 


Version 2 


0 19 


.40 


ok 


X 


Q20 


.33 


ok 


X 


021 


.36 


X 


X 


0 22 


.41 


ok 


X 


023 


.38 


ok 


X 


024 


.25 


X 


X 


025 


.25 


ok 


X 


0 26 


.26 


ok 


X 


027 


.30 


X 


X 


0 28 


.48 


ok 


ok 


029 


.38 


ok 


X 


O30 


.49 


ok 


ok 


031 


.45 


ok 


ok 


0 32 


.48 


ok 


ok 


033 


.53 


ok 


ok 


034 


.29 


X 


X 


035 


.39 


ok 


X 


0 36 


.30 


X 


X 


Subscale 
Correlation 


• 

.56 


.55 


.61 




Items 


18 


13 


5 


Reliability 


.93 


.93 


.86 
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Table 17d: Item and Subscale Correlations with Student Achievement 

Student Expectations 



Item 
Number 


Correlation 


Version 1 


Version 2 


012 


.31 


ok 


X 


0 37 


.36 


ok 


ok 


0 38 


.48 


ok 


ok 


0 39 


.16 (n.s.) 


X 


X 


O40 


.29 


ok 


ok 


041 


.27 


ok 


X 


0 42 


.23 


X 


X 


0 43 


.30 


ok 


ok 


044 


.22 


X 


X 


0 45 


.20 


X 


X 


0 46 


.26 


ok 


X 


047 


.26 


X 


X 


048 


.38 


ok 


ok 


049 


.25 


ok 


X 


O50 


.28 


ok 


X 


051 


.19 


ok 


X 


0 52 


.20 


X 


X 


Subscale 
Correlation 


.45 


.46 


.49 




Items 


17 


11 


5 


Reliability 


.89 


.88 


.79 



^ote: Question 42 recommended for elimination due to percent neutral responses-33%) 
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Table 17e: Item and Subscale Conelations with Student Achievement 

Opportunity to Learn 





rv>rr<*1 2) tint! 


V^rcinn 1 


V vX dXvll A* 


O 53 


20 


x 


X 




16 s ^ 


ok 


X 


0 55 


26 


ok 


X 


0 56 


.24 


ok 


X 


057 


.18 


ok 


X 


058 


.22 


X 


X 


059 


.32 


ok 


ok 


O60 


.25 


X 


X 


0 61 


.30 


ok 


ok 


0 62 


.35 


ok 


ok 


0 63 


.34 


ok 


ok 


064 


.25 


X 


X 


065 


.23 


ok 


X 


066 


.28 


ok 


ok 


0 67 


.25 


ok 


X 


Q68 


- .14 (n.s.) 


X 


X 


069 


.14 (n.s.) 


X 


X 


O70 


.10 (n.s.) 


X 


X 


071 


.24 


ok 


X 


Subscale 
Correlation 


.34 


.43 


.43 




Items 


19 


12 


5 


Reliability 


.91 


.88 


.77 
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Table 17f: Item and Subscale Correlations with Student Achievement 

Instructional Leadership 



tfiin i 
Number 1 


Correlation 1 


Version 1 1 


Version 2 1 
1 


072 


.39 


X 


ok 


0 73 1 


.37 


ok 


ok 


Q74 1 


.30 


ok 


X 1 


Q75 


.30 


ok 


X 


976 


.23 


X 


X 


977 


.IHn.s.) 


X 


X 1 


0 78 


.29 1 


ok 


X 1 


0 79 


.28. 


ok 


1 

I 


O80 1 


.23 


^iT 1 


Y 1 
1 


0 81 


.28 


ok 


Y 1 
1 


0 82 1 


.31 


OK 1 


ok 1 


983 


»2o 


A. 


X 1 


084 


.28 


X 


X 


n 9S 


.24 


ok 


X 


0 86 


.20 


■ X 


1 X 


0 87 


.19 


X 


X 


0 88 


.24 


ok 


X 


089 


1 .16(n.s.) 


X 


X 


990 


.36 


ok 


ok 




.26 


X 


X 


092 


.34 


ok 


ok 


093 


.23 


X 


X 


1 Subscale 
1 Correlation 


1 .38 


1 .42 


1 .44 1 



1 Items 


22 


11 




1 Reliability 


.95 


.93 


.86 1 



(Note: Questions 86 and 87 deleted due to percent neutral responses=33%) 



ERIC 



55 60 



Table 17g: Item and Subscale Correlations with Student Achievement 

Home-School Relations 



Item 
Number 


Correlation 


Version 1 


Version 2 


Q 94 


- .02 (n.s.) 


A 


A 


0 95 


.07 (n.s.) 


OK 


Y 

A 


0 96 


.13 (n.s.) 


OK 


Y 

A 


0 97 


.09 (n.s.) 


X 


Y 

A 


0 98 


.26 


OK 


OK 


r\ Aft 


.uz (n.s.) 


A 


Y 
A 


U Iw 


.ID (n.s.j 


Y 

A 




iUi 






X 




15 fn s "i 


X 


X 


O 103 


.20 


X 


X 


0 104 


.20 


ok 


X 


0 105 


.34 


ok 


ok 


O106- 


.18 


X 


X 


O107 


.21 


ok 


X 


O108 


.23 


ok 


X 


O109 


.31 


X 


ok 


Olio 


.11 (n.s.) 


X 


X 


0111 


.08 (n.s.) 


ok 


X 


0112 


.19 


X 


X 


0113 


.24 


ok 


ok 


0114 


.41 


ok 


X 


0115 


.33 


ok 


ok 


Q116 


-.01 (n.s.) 


ok 


X 


0117 


.15 (n.s.) 


X 


X 


Subscale 
Correlation 


.28 


.32 


.39 




Items 


24 


13 


5 


Reliability 


.92 


.89 


.82 
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Table 17h: Item and Subscale Correlations with Student Achievement 
Summary for all Subscales 



Item Number 


Correlation 


Version 1 


Version 2 


School 
Mission 


.36 


.37 




Monitoring 
Progress 


.30 


.30 




Safe 
School 


.56 


.59 


.01 


Student 
Exoectations 


Al 


.48 


AO 


Opportunity 
to Learn 


.40 


.41 


43 


School 
Leadership 


.39 


.41 


.44 


Home-School 
Relations 


.32 


.35 


.39 


Total 

Correlation 


.49 


.50 


.54 






litems 


117 


75 


35 


1 ReUabiUty 


.98 


.98 


.96 



Summary of flndinss and Recommendations 

Given the s^ioach that was used, the data in Tables 17a - 17g seem to suggest the following: 

• Committee recommendations for eUminating items led to the reduction of survey 
items from 117 to 75 (Version 1). 

• Use of a polarized calibration sample (top four high performing schools + bottom 
four low performing schools) increased item and subscale correlations with student 
adiievement. 

• In all cases except one (Monitoring Student Progress), successive shortening of the 
survey instrument led to improved subscale and total correlations with student 
achievement. Decreases inieliability estimates were negUgible overall; howev», the 
reliability of individual subscales was reduced as items were eliminated, but still 
maintained acceptable levels (e.g., minimum for Version 2 = .77; maximum = .82). 
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. The subscale of items pertaining to a school's Safe and Orderly Environment had the 
highest condation with student achievement of any other subscale or even the total of 
all items Next came the total of all items, then Student Expectations, School 
Leadership, Opportunity to Learn. School Mission and Home-School Relations 
subscales were followed only by Monitoring Student Progress. 

• niough Version 2 was not chosen as the recommended survey form for future use, it 
remains a viable alternative should there be a compelling need for an even shorter 

version. / 

/ 
/ 
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section S: Who, Parent. SaiHanimm Say) Moot PUo, Project SchooU 

^ ^« c«mA nf the technical issues associated with th<? 
The puipose of this section is to rq»rt on '"T.f*^*^'^ results from the 16 schools 
SuccL^ schools parent survey »d also «> J^^^^ \l exdusivdy with the • 
which participated in the initial i^dd-ttst ^« »;'™™^^ u, Mp r<«md out the 

sumdardized (or "bubble" "f<^\^Zk^^7^ '^^^^'^ 

picture of achievenKnt and ^^^^Z^^Zt 03 item) survey, parents did not 

the field-test sugg^ ^^Z mTL time. When parents did respond, th^ 



environment. 
The Respondents 



,^«asatotalof..382"parent»^ys«»u^*^ 

The first part of the parent survey f^,,f ."TS^/X child who brought the survey 
,u«tionnaire or '^J^r^'^,^^^ Z^. whether the parent workjd 
home, the total number of their chilcteai wno^ ^ ^ respondent's 

outside of the home, the total number of "'"'^^S " this ark blank than answered 
M^t level of education. ^'^<f^y'r^^^^£^ot the location of this 
thi questions, perhaps because of the fine "^/^^^"^X survey. The 6ct that the 

S^^L^^^uiraJhave contributed to the low response rate. 

Of those residents who did answer questions i. the demographic section, it was found that: 

. Thegradelevelsofchiidren^t^dingt^P^t,^^^^^ 
from Kindergarten through grade five at between 14% ana is* eac 
2% reported as dxth graders. 

. The total number of children attending . particular pilot school effectively ranged 
from one to five with the average bemg 1.8. 

. The total number of adults Uving in the home effectively ranged from one to two. 
wi^to ™s"mi«orlty 97% indicating a single parent household. 
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;i,j:i:r si sr-ss r..po.... «.» ..ciui.... 



9^ " G4 



^ ^ indicated thev had not finished high school, 

training, and 14% said they had a college degree. 

While ^ den^graphic profOe ^-^^^i:ZT^l:^i'^^ 
questions as to its accuraqr. ^^^'^^^ mle much of the demogn^Wc 

"'vST to ap^u.^ ^-"^ ^''^ "^"^ 
information was sketchy, this appears w ~ 

as anything else. 
Representation of Respondents 

PHortoanalysisoftecMcaipto^ofU^P^U^^^ 
questions was addressed tepiiding npresauparem at targe in Ae 

S^ted in the data. To wte ""fJ^Z^T^ S=lc rfVsentation would 
Jtf piKw schools? This question is .«f -"""^^^f*^ ' f"^,^ . idi^iUty and validity) 
Bnrit the extent to which the tectatol p»P^» ^l^^^t^Z^^ 
could be estimated with »y te^-^" 

Sd^^'t^i^^ st^ir -^"^^0?^-^- va^ as .0 Whether they 
were printed in EngUsh, Spanish or Haitian. 

accordingly a faU ^^r^^^:>^::^^^^^ 

SLt r 0^ Z d-Tg^lu ar::.T.«o students p.- household 
and the predominance of dngle parent households. 

Table 18 on the following page shows the ^t ^ stu^^ ^'^^^JSI^'orSHS 
survey data collected. The data "^^T^^l^^^ S^of the pilot p«.ject 
lower achieving schools that have Mgher acMeving schools (A 

are referred to as Group "B". 
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Table 18: Percent of Students Represented by Parent Surveys 




There was considerable variance between schools, with the percent of students represented 
There '^'^f^''^''^^'^^.^ a grand total of 11.725 students in membership and 2.382 

reliability and validity estimates. 

As a footnote to the previous discussion, it c» be pointed out tl»t eight 

AswOl itwould be interesting to know what happened m other schools (e.g.. G. 

respondents? 
Reliability and Validity 

Tn ^hni ^em did the parent survey yield reliable and valid responses? Basically the same 
I^^^^wl us^^^^ rdiabiUty and validity of the parent survey as w«c 

^^Tthe^^eJ Sdof using aU available responses, these techmcal issu<» were 
f^^sS: c^^don sample that consisted of responses from the four bg^ 
r^v^S acSngof the 16 pUot project .hools -^^^^^J^^^ 
to maximize the potential contrast among respondents whose children attended schools at me 
opposite ends of the achievement spectrum. 



" 66 



ReliabiUty estimates were determined on the basis of Cronbach's alpha. Predictive validity 
was estimated on the basis of item and subscale correlations with aggregate achievement and 
also with indicators of a school's learning environment as an alternative strategy. The highest 
achieving schools in the calibration sample included schools A, B, C, and D; tiie lowest 
performing schools included M, N, O, P. In both cases, the achievement statiis of a school 
was determined by a composite of reading, writing and math scores, converted to normalized 
ranks in relation to all elementary schools in the state. For comparative purposes, a similar 
index was created from normalized ranks associated with promotion, attendance and 
suspension rates. Relationships with both indices are shown in Table 19. 

Table 19: Item Correlations with Student Performance and 
Learning Environment 



Item 
Number 


Student 1 
Acmevemcni i 


Pnvironment 1 


Q 1 


n'^ 1 


.13 


0 2 


- 02 


**.21 1 


Q 3 


— ni 

~ .wl 1 


.161 


Q ^ 


~.UO 1 


.07 1 


q 5 


.Vrt 1 


**.27 


0 6 


_ AC 
.VJ 1 


.06 


0 7 


.04 


.07 1 


0 8 


.02 


.07 


Q 9 


.03 


.02 


OlO 


.11 


.08 


pll 


-.05' 


-.05 


012 


-.07 


.00 


0 13 


.10 


.04 


0 14 


-.04 




0 15 


-.06 


.04 


0 16 


-.04 


-05 


0 17 


.01 


-.02 


0 18 


.01 


.07 


0 19 


-.02 


- .03 


0 20 


.04 


.06 


0 21 


*.14 


**.21 


0 22 


.04 


M4 


023 


.01 


.09 


Total 


.02 


1 .12 1 



(* p<.01and**p<.001) 
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While the overall reliability (mtemal consistency) of the parent survey instrument was 
estimated at .92, there is little indication of predictive validity, especially with student 
achievement. Item #21 ("I would rate this school as superior") had the only correlation that 
was statistically significant, but was only weakly related to student achievement. 

The correlation of parent survey items with learning environment was generally higher than 
with achievement, but still not high enough to argue for predictive validity. Items #21 (as 
previously stated), #5 ("Parents are encouraged to share ideas for school improvement with 
administration and staff in this school."), #2 ("The activities of the parent group support the 
school's goals."), and #22 ("Communication from the school is clear, effective and frequent.") 
were the only ones that had statistically significant correlations, but were still only weakly 
related to learning environment. 

These findings are in stark contrast to the results of the technical analysis for the staff survey 
where all correlations with achievement were statistically significant and exhibited a somewhat 
consistent and substantial pattern of relationships. The major conclusion that can be drawn 
from these data is that the parent survey appears to be sufficiently reliable, but has very low 
predictive validity with regard to the major areas of concern in this study-student achievement 
and learning environment. On the other hand, the majority of items in the parent survey stem 
directly from the Home-School Relations section of the staff survey. Also, they were 
developed through consensus negotiation among a panel of evaluation specialists. From this 
pen^tive, there is support for face validity. But what are the items in the survey measuring? 

Having at least passed the reliability test, perhaps the answer can be found in further analyzing 
the results from the pilot project administration. However, there are other technical issues that 
need to be addressed before responses are aggregated. 

Representation of Schools 

Looking back to Table 18, one of the most striking features of the data is the highly 
disproportionate number of parent surveys collected at school "J" as compared to all others. 
This observation leads to another research question dealing with lepiesentation: To what 
extent do the responses represent parents at individual schools? This question is important 
because an uneven distribution of survey respondents across schools could affect the extent to 
which aggregate results would be representative of the two groups. The question was 
addiessed by comparing the percent of students in membership versus Uie percent of surveys 
within each group of schools. Results are provided in Table 20a on the next page. 
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Table 20a: Representation of Schools within Comparison Groups 



GrouD "A" 




Group "B" 




Pilot 
School 


Percent 

of 
Students 


Percent 

of 
Surveys 




Pilot 
School 


Percent 

of 
Students 


x^erceni 

nf 


A 


9% 


11% 




I 


10% 


2% 


B 


12% 


14% 




T 
J 


17% 


64% 


C 


11% 


10% 




K 


11% 


10% 


D 


11% 


18% 




L 


15% 


6% 


E 


12% 


16% 




M 


8% 


4% 


F 


15% 


15% 




N 


15% 


5% 


G 


14% 


1% 




0 


13% 


8% 


H 


16% 


14% 




P 


10% 


2% 


Total 


100% 


100% m 


1 Total 


100% 


100% 



From the data in Table 20a, it can be seen that three schools (G, I, and P) are very much 
under-represented overall and that one school (J) accounts for nearly two-thirds of the survey 
data for Group "E" and over one-thiid of the total surveys coUected. From the perspective of 
aggregate data for Group "B", school "J" was so much over-represented that it virtually 
dominated all other responses. In order to proceed with aggregation of responses by group, 
some adjustment had to be made in order to reduce the lopsided representation by just one 
school. 

It was decided that random sampling would be used to reduce over-representation for the one 
dominant school. But how many cases should be drawn? The process of adjusting the number 
of survey responses for school "J" was one of successive ^roximation, taking mto account 
their proportion of students in the group, as well as the extent of over-representation in the 
school with the next largest number of surveys (K). As seen in Table 20b, the adjustment 
process resulted in a greatly reduced number of surveys from school "J". Even so, parity was 
maintained between the relative number of students and the relative number of parent surveys 
in the group. As well, school "J" remained the most over-represented in Group "B", just more 
reasonably so. This adjustment also had the net effect of increasing representation for aU other 
schools in the group. Unfortunately, there was nothing that could be done about the very low 
level of representation for schools G, I, and P. 
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Table 20b: Net Effect of Sampling Responses from School "J* 



Grout 


>"B" 


PUot 
School 


Percent 

of 
Students 


Number 

of 
Surveys 


Percent 

01 

aurveys 


I 


10% 


31 




J 


17% 


175 


27% 


K 


11% 


131 


20% 


L 


15% 


73 


11% 


M 


8% 


52 


8% 


N 


15% 


64 


10% 


0 


13% 


100 


15% 


P 


10% 


22 


4% 


Total 


100% 


648 


100% 



From this point on, all results ate reportoid based on the adjusted number of responses from 
school "J". No other school's responses were sampled. 

Missins and "Don't Know" Responses 

Yet another consideration before aggregating results for Group "A" versus Group "B" schools 
was the issue of relatively large amounts of missing data and "Don't Itoow responses, 
especially in reference to fectual statements such as the existence of a wntten disaphne policy, 
an^ctive parent group, or a statement of purpose for the school. To what extent M missing 
or 'Don'tKnoW responses diaraaerize the survey data? What do the patterns 
data or 'Don't Know' responses reveal? The feet that so many rcspondcmts simply did not 
answer certain items or said they did not know turned out to be one of its most stnkmg 
features of the field test results. 

Table 21a lists five items for which half or more of the pUot schools had 33% or morc^ne 
out of three, or more) missing or "Don't Know" responses. The items have been arranged m 
descending order according to the number of schools affected. 

Table 21a: Items with High Numbers of Missing and "Don't Know" Responses 



Survey 
Item 


High 
Achieving 


Low 
Achieving 


Total 
Schools 


20 


6/8 


7/8 


13/16 


5 


6/8 


5/8 


11/16 


3 


4/8 


5/8 


9/16 


8 


5/8 


4/8 


9/16 


1 


4/8 


4/8 


8/16 
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The following are the actual survey questions associated with items that had the highest 
incidence of missing or "Don't Know" responses: 

#20: A written statement of purpose exists for this school 

#5: Parents are encouraged to share ideas for school improvement with administration 
and staff in this school. 

#3: The parent organization of this school is considered important by the 
administration and teachers. 

#8: My child's teachers spend more time communicating with me about the good 
things my child does than the bad. 

#1 : There is an active parent group at this school. 

Items for which there were large numbers of missing or "Don't Know" responses point to 
three areas of parental involvement where there appears to be a low level of awareness or a 
general reluctance to respond: 

1. School mission or purpose 

2. Status of the local parent organization 

3. Positive feedback from/input to school improvement 

On the other hand, there were five items which had a relatively low incidence of missing or 
"Don't Know" responses (10% or fewer in two-thirds or more of the schools). 

Table 21b: Items with Low Numbers of Missing and "Don't Know" Responses 



Survey 
Item 


High 
Achieving 


Low 
Achieving 


Total 
Schools 


6 


8/8 


7/8 


15/16 


12 


7/8 


7/8 


14/16 


17 


6/8 


7/8 


13/16 


18 


5/8 


7/8 


12/16 


16 


4/8 


7/8 


11/16 



The following are the actual survey questions associated with items that had the lowest 
incidence of missing or "Don't Know" responses: 

#6: I fed free to initiate contact with my child's teacher. 

#12: I make an effort to be informed about my child's educational program. 
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#17: I cooperate with my chUd's teacher to see that homework is completed. 
#18: My child completes assigned homework before going to school. 
#16: I support the school homework poUcy. 

for which U»re we« «f «iy 'aw «un*^of ^ss^g^^^ 

represent things that parents are supposed to do. 

1. Communication with child's teacher 

2. Awareness of chUd's educational program 

3. Support of homework policy 

Results from the Field-Test Admimstration 

Mrti^ouivh fwtween hizher and lower achieving schools? Using 
DHpcremjunxy ^T?"^ *f "i^l^tS™^ower achieving and wift . sample 

display. 

Table 22: Parent Sumy Hems and Responses for Group "A" and "B« Schools 



Item Number and Content 

1. There is an active parent grou p at this school 

2. The activities of the parent groiq> support the 
school's goals. ; ■ 

3. The parent organization of this school is 
cJmsidered important by the administration and 
teachers. 



parocipaic. -— 

5. Parents arc encouraged to share ideas 
d1 improvemo * 
in this school. 



for 



Don't 1 








Know 1 


A^ 




uisag 




Group 
"A" 


Group 
"B" 


Group 
"A" 


Group 
"B" 


Group 
"A" 


Group 1 
"B" 1 


31% 


33% 


65% 


61% 


4% 


6% 1 


31% 


31% 


66% 


63% 


3% 


6% 1 


21% 


21% 


76% 


72% 


3% 


7% 


17% 


13% 


76% 


75% 


8% 


12% 


r 

14% 


14% 


81% 


78% 


5% 


7% 
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Table 22: (Continued) 





Don't 

Know 


Agree 


Disagi 


w 1 


! ' 

1 Item Number and Content 


Broup < 

« A " 1 

A 


Group < 

0 


3roup ( 

"A" 1 


jroup Group y 
-B" "A" 


jroup 1 

n'Dii 1 

IS 1 


6. I feel free to initiate contact with my chUd's 
1 teacher. - — \- 


^% 1 


4% 


92% 


on% 1 


5% 


6% 


7. My child's teacher keeps me intormed aboui 
my child through phone calls, class newsletters, 


f\ tit 1 

3% 


'SOL 1 


OOTO 1 


89% 


9% 


10% 


1 and/or notes home. ; — j- 

iQ TmZ /«hiiH'G teachers sDcnd more time 1 
communicating with me about the good things 
1 bv child does than the bad. L 

9. I have been invited to visit and observe my 

1 child's classroom. I 

10. I attend school activities, such as sports 


10% 


7% 


66% 


67% 


23% 


25% 1 


7% 


7% 


mm^ iff 1 

76% 


77% 1 


18% 


17% 


7% 


Q<£ 1 
070 1 


7^% 1 

/370 1 


74% 


18% 


18% I 


1 events, plays^ concerts, awards assemblies. 

11. If my child break a school rule, I support the 

1 4>aQ/*h»r \t% Aicf*it\l\x\\t\P mv Cnlld* ' 


8% ' 


I 8% 


86% 


85% 


7% 


8% 1 


1 ^cicncr in msft^ipmu^^s *" j — 

12. I make an effort to be informed about my 
child's educational program. 


5% 


3% 


91% 


93% 


4% 


3% 


1 13. Parent and/or commumty memoers are 

1 frequent volunteers in this school. 

14/ Parent-teacher conferences usually focus on 


29% 
10% 


26% 
10% 


67% 


68% 


4% 


6% 


79% 


80% 


11% 


10% I 


how well mv chad is doing in schoolwork. — 
15. Parent-teacher conferences usua^icsult in a 
SDCcific plan of how I can help mv child. 


10% 
7% 


10% 
5% 


83% 

1 AO Jl# 

88% 


83% 
89% 


7% 
5% 


7% 
6% 1 


16. 1 support the school homework policy. 

17. I cooperate with my child's teacher to see 
1 that homework is compieteq. . 

18. My child completes assigned homework 
1 before goinp to school. . 


4% 
5% 


3% 


93% 


1 7370 


3% 


3% 1 


1 3% 
14% 

J 33% 
1 15% 


90% 

61% 
76% 


90% 
79% 

63% 
J 72% 


6% 
7% 

5% 
9% 


7% 1 

1 tM. \ 

1 xyn 1 


19. 1 am aware of a written discipline policy. 
1 20. A written statement 01 purpose cu5ut lu* una 
1 school. ; 


3% 
34% 


4% 1 

13% 1 


1 21. 1 would rate this school as superior. 

22. Communication from the school is clear 

1 effective and frequent. 

1 23. 1 am actively involved in mv child's school. 


15% 
9% 


9% 


81% 


80% 


10% 


11% 


1 9% 


1 8% 


1 61% 


1 66% 


31% 


1 26% 1 





With few exceptions, when parents did respond, they tended to agree with almost item 
ZT^rJL^. These resdS are reminiscent of pubUc attitudes toward local schools as 
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considerably lower grades: only 22% awara 

ui ♦othi.noll When asked whether they 
^ p,^. survey da,, ^^,_T:^JIT.C »^«-.r^A»t 

, Md,U«re was a difference of 10% or n«Ke between pa«nt 
I am aware of a written discipline poUcy. 

"D 't Know" or be in agreenieni 
Despite the general trend to either not re^nd answ^ Don istinguished between 

achieving schools. 
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Sec^n9: ,„en,Su.ey, Responds U.Open.me^Q>-'s>ions 



, ■,.n« on me parent quesUonaaire, me toU»wing three open- 
to addiUon to the 23 Ukett-scale .terns on me paen q 
ended questions were included: 

3 Please provide other comments. 
„^u.pare„.s.erecoded^^^r:^y"^^^^ 
^er»V-Sn»US.en.stomequest>on. 

d««e„ce . me pcr«..a.e o^^^^'-^r ^n*. 

^ U a., school D.1-S that Most Hdpl-U.. Y.»r ChBa7 

cSy environment, setting ^ghe. f^<«a^ '^f^B at higher petfoitning scto^ 
°^lu^on. Aimough a *^^«^«o'^'^Sud not difto significantty ftom 
Sr'trJ^SXtfSi.yof.l.esecorrelates. 
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Table 23: Responses to Qu esUon 1 

schools (n^67gL J""" ' .'^ p,,.caa 

l^^^i^c^ — > 

• Significant at alpha < .01. 

„^Bomtypes.»«l»np»».*'«»» ,i„ most foq»«t response for 

This ^Wpto^^^ ^ «^4L^tor&i>« 

g«a»er ""PJ'^.^^^iSanfly peato SIS should 

improved. WheU«r fl^^^^^ is an area for tother exploration, 
^tt^twoschoolsoradtflerencempercep school was ate-ly 

commumcauon, wiui «uwu 
^^tion should be improved. 
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Table 24: Responses to Question 2 



Successft'^ Schools Correlate 
Provides Safe/ '^^^^y Environment 
Has a Qear School Mission — _ 
Provides Inst" 'crional Leadershi] 
Sets Higher Ex pectations 
Pmvidfts Op portunity toj^rn 



Provide Extra Hdt 

Atcif rn Homework * 

T«tchers/Strategies. 



Higher Performing 
Schools (n=678] 



Number 

50 
152 
5. 

240 



76 

IL 
13_ 

91. 

21_ 

90 



9% 



Lower Performing I All 
Schools (n«5 39) Schools 



13%_ 
5% 
2%_ 
16%_ 
4% 
16% 



124 
± 
34 
212 



58_ 
46_ 
17 
77 
8_ 
74 



Percent 1 Percent 



25% 
<1% 
7% 
42% 



2% 
15% 



3% 
15% 



Provides C ^^r^fJtlTimt in Class 

Monitors Stude nt Progress Often 

Im prove Home^ g^^'""^ Communication _ 

* Significant at alpha < .01. 
Please Provide Other Comments 

A' ;otn two catcEories for each correlate - positive 
Other comments from parents "^^^"^^^"^^^^ .^^^^^ cmrt^ who walk to school 
comments and negative comments; ^^^^^'^J^^'^f^, and Orderly Environment.- 

ssru^r^gS^"^^^^ 

.gain, parents in lower V^^^^^c^^jZ.^^^ 
negatively on the safety and ^^^^^f^^/ ^^Sr«)m^^ was needed to make the 
the parents in P^^^^f,^^^^ security, better traffic control 

environment safer and more orderly. discipline procedures. Comments like the 

with discipline. Rules need to be enforced, 
people." 

. larger ^reentage of parents ov«^ — ^^^^ 
(12%) than commented P<>«^^«?y Negative comments would include a 

the two groups of schools on either m^^^ ti„e spent on academics, 

need for more individual attention, more homework, ano more um 
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schoo , which ^as coaea as^ rx-rcentages of parents at lower and higher performing 
SlUS.:^^ iS^SrS in Of oo^nunication. 



Table 25: Responses to Question 3 

Oth er Comments 

Higher Performing 
Schools (n^^aOll 




Lower Performing 
Schools (n=291) 



All 
Schools 
P ercen t 
13% 
29% 
6% 
9% 
12% 

_13% 

J I I /V I 1 ^- ( 

. . — I — I T^T^. 1 oo I n« 

Need Home/School Commumcation 

* Significant at alpha < .01. 
Summary 

. In general, parents were positive about thdr schools, indicating that the way in 
wWch S^helps their children most is to provide them with an opportumty to 

learn. 

. Parents at higher performing schools were significanUy more likely to identify 
J^Xi^s^sl^^y in which the school helped their child. THesc 5)eaal 
^TiSld B^^tiLa Student Education, after school tutoring, and Chapter 1. 

. Parents at higher performing schools were also significantly more likely to comment 
positively about their child's teacher. 

that *e school should assign more homework or improve the homework policy. 
. Reinfordni the results of the staff sorvey. parents at lower and W^peAttming 
^SSdlgnificanay in their percepti«. of whether the f^^f^T^^^' 
L orderly enviKiment for leandnt. Itonts at lower p«tomnjid^Uj^«^ 
m imprmement was needed in sudi areas as secunty, respect for others, and 
discipline. 



73 

78 



SecHon 10: Succestful High Poverty Schools Study, 
Oti'SUe Interview Analysis 



Overview 

The focus of this report is to offer interim results of the Successful Schools pUot project on-site 
interviews. The principal questions that guided the analysis of the interviews were the same as 
pUot project's main research questions. The questions were: Are the survey and interview 
instruments appropriate for continued research efforts? Which elements are characteristic of 
successful high poverty schools? However, the appropriateness of the instrument and other 
on-site interview logistical considerations are discussed in another section of this technical 
report. 

There were more than 200 respondents to the Successful Schools interviews in sixteen Florida 
schools. Over 250 pages of transcribed notes and more than 1,000 supporting documents are 
being considered. The amount of information and data gathered was voluminous and its 
processing continues. Results presented here are a summary of the comments and feedback 
received from seven of the Chapter 1 schools. Included in the survey were supervisors, school 
principals, teachers, counselors, custodians, para-professionals and parents (see Table 25). 

The schools that were visited are located across the state in six counties and represented a 
selection of high and low performing Chapter 1 schools. While all Chapter 1 scnools offer 
compensatory services to students with academic deficiencies, the common elemeiit shared by 
the schools visited is thdr Free or Reduced Lunch (FRL) rate. All of the schools visited were 
at or over the 75% FRL rate. 

The main tool used to interpret the comments and observations provided by the interviewees 
was QUALPRO (QP) software, a text-database manager. This software package provided the 
framework to code, group and identify significant features from interview results. The 
interview forms were transcribed into a word processing format (WordPerfect) then imported 
into QP. The program then blocked and numbered the transcribed text. Copies of the 
transcribed text were made available to the interviewers for their review. Edits were made to 
ensure that the transcribed text was as close to the interviewer's handwritten notes as possible. 
Initially, codes or key words were assigned for each answer. These codes were then entered 
into QP. The program could then provide code Usts, frequencies, as weU as citations of 
selected codes used. An interdiability check is also planned. A limit of 75% was set for the 
validity of the codes. The three coders need to agree at 75% or more of the times on the codes 
selected to represent the text being considered. 

Codes used in this part of the report are synonymous with the main concepts expressed in 
interview answers. Whenever possible, the codes used were of "yes or no" types for 
quantification purposes. Nonetheless, many of the questions could not be, or were not, 
answered in this format and key descriptors were used as codes. The majority of the questions 
used were open-ended and therefore answers varied in length and scope. Interview questions, 
whenever possible, were grouped to match appropriate correlates. 
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Preliminary Findings 



Instructional Leadership 

The schools in this summary overwhelmingly identified their staff and teachers as the main 
element that made their schools successful. The majority of respondents (65%) identified the 
school staff as being the key to their success and specificaUy acknowledged then- teachers as 
evidenced by comments such as the following in response to: "What makes this a good 
school?": 

"Dedicated, enthusiastic, talented staff who put in many hours beyond the 
school day." "High level of commitment of teachers." "Teachers make all the 
difference." 

Additionally, teachers' attitudes, commitment and the behavior modeled were particularly cited 
by the interviewees. Respondents also mentioned other elements they considered contributors 
to their success such as: leadership, facility, resources, technology, parents, and others. 

Of particular interest were the answers of two high performing schools and two low 
performing schools. Although all four schools agreed that teachers were the mam clement m 
the success of the school, principals' InstrucUonal Leadership styles were different. The 
two high performing schools considered in this report, embraced shared decision-making and 
valued their teachers' ideas. Administrators at those two schools als^o encouraged nsk-taking 
and creativity. In low performing schools, directors requested thdr teachers' input to approve 
or disapprove instructional programs or ideas that had been made by the school district or the 
director. Hie difference between high and low performing schools was evident. 



Safe and Orderly Environment 

Interviewees consider their work place safe. The faculty, staff and parents assessed the 
schools a safe place in which to study and work. Answers at six out of the seven schools 
provided the following comments: 

•Never thought about it. Do not fed unsafe. Safe haven. Police availability." 
or "Yes. No problems arc anticipated; no fears; no unsafe events." 

Personnel interviewed had no concerns for their welfeic while in the school. Noncthdess, 
there was one school where some staff memben did not fed completdy safe. The responses 
rccdvcd at that school indicated that they were concerned both with the neighborhood and the 
access from outside the school. These respondents made a distinction between feding safe in 
the school and safe in the surrounding community. This feet was evidenced by comments such 
as: 
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"Yes. Environment outside not secure. OveraU school kept safe. If something 
is going on in the neighborhood, we're safe and locked up in our rooms."; and 
"Basically, like any other place. Vandalism. Would not stay after six." 

A comparison of the high and low achieving schools did not yield different results. 

Of seventy-four respondents in the seven schools considered, sixty-four (86%) would want 
their own chUdren to attend the school in which they work. The personnel interviewed 
considered their schools to have appropriate curriculums and they did not fear for their 
children's safety. The ten respondents who would not send their own children to the school 
where they worked had different reasons for not wanting their children there. Some of the 
reasons were fear of the neighborhood, fear of retaliation and religious reasons. 

Respondents (71%) from one of the low performing schools would not have their chUdren 
attend the school they worked in. They mentioned discipline problems- neighborhood, and 
vengeance as the main reasons for not wanting some dose to them at their campus. 

Additionally, there were various groups of duldren that were identified as presenthig 
discipline problems. Some of the groups identified were: (1) students with emotional 
problems, (2) gender specific groups and (3) students with academic problems. Among the 
majority of respondents (31%) who answered "Yes," when asked: "Are there particular 
groups of students that present behavior problems?", identified students with famfly problems 
(ten of thirty-two responses). Comments were related to the home, parents and btshavior 
problems out of school. Examples of those comments include: 

"Of course. Children that have mothers who don't care."; "Yes. Students that 
are seeking attention - there is something going on at home." and others. 

High Expectations 

Ninety-two percent of the interviewees expected th«r students, in the schools considered in 
this summary to perform as well as students in other schools in the district. The expectations 
were high and the commitment to enhance and promote their potential was communicated 
throughout the interviews. Only one out of twenty-eight respondents did not expect students 
at their school to perform as weU as other students; the person interviewed considered thU a 
comparison and refused to compart students. Other respondents shared the dislike for 
comparing but would set the same expectations on any student in their district. An analysis of 
the low and high performing schools did not yield different results. 

Clear School Mission 

The main focus of the two top performing schools is their students when they arc discussing 
the school mission. In contrast, the two low performing schools had difficulty agrecmg on 
what their school mission is. The low performers viewed their mission as providing services 
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to the children and families that they may otherwise not receive. Other schools emphasized 
the development of self-esteem in their students as the main focus of their school. 
Nonetheless, the low performing schools could not agree on what the school mission was for 
their school. 

The results of this analysis are inconclusive. All of the sixteen schools have not been 
considered for this report. Additionally, the documents provided by the schools visited are 
still being processed. Nevertheless, up to this point there appears to be no significant 
differences between high and low performing schools with the exception of the Instruction 
Leadership style of the administrators. All other features appear to exist in all of the schools 
considered. 
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Section 11: Succestful Schools Study, Procedural Analysis ofOn-Site Visits 



The purpose of this section is to share observations and recommoidations related to the 
procedural aspects of the on-site visits. 

Interview Questions 

The interview was thought to need more focused questions and not to be tied to other 
knowledge, beyond the role of the interviewee. The focus of the questionnaire should not be 
redundant from the surveys that were sent out to the feculty members. There were a variety of 
comments pertaining to the elimination of questions from the on-site interview questionnaire. 
Only two teams identified the specific questions on particular questionnaires tiiat should be 
dropped. The remaining teams, witii few exceptions, made either broad comments about 
questions or suggested tiie elimination of certain personnel from tiie interview process. The 
main concern was tiiat particular questions were not felt to be germane to tiie roles played by 
the staff. Other comments about specific questions included the elimination of the question on 
the "typical day". The remarks suggested that because we collect a sample schedule from 
teachers, tiiere is no need to ask diis question. Recommendation: Hie question, "Describe a 
typical day for your students" should be eliminated from all the hiterview questionnaires 
used In the study. 

It was further suggested tliat the question on writing use in math and science, be clarified. 
There was a lack of understanding both on the part of the interviewee as wdl as the 
interviewer as to what this question meant and how it might be answered. Recommendation: 
The question, "What opportunities are offered to your students to use writing hi math 
and science?" should be changed to read "What opportunities are offered to your 
students to use the vrithig skills they have learned 

Suggestions to modify the questionnaires pointed out the need to add the question "Is there 
anything you would like to say about the school?". Recommendation: The question, "Is 
there anythhig you would like to say about the school?" should be added to all the 
interview questionnaures. 

Some members of the visiting teams felt that the parent interview did not reveal significant 
information. Others found the parent interview to be insightful. Recommendation: The 
parent interview should remain a part of the on-site school study. 

In some c?ses the questionnaires wwe described as too long or repetitive. Team members 
mentioned tiiat personnel who do not have recent classroom experience have difficulty 
answering some of tiie questions. There was a comment made tiiat stated, "we're not getting at 
tiie instructional strategies witii our questions". Recommendation: The eUmhiation of 
questions from the hiterview questionnaires will be addressed hi remahider of this 
document. Ibe question, "What histructional strategies are most successful for you?", 
should be added to the faculty and principal Interview questionnaires. 
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An *e .ea^s agreed ^\^'^'^f'r^J^\^X'lZ:^ 

insmiment appears to ^Lunce It was seen as helpM when the Ch^ter 1 

difficult to an^r, by -^"^ '^'^^il^e^districtsWt rt^ a longer 
coordinator was interviewed at "^'^^ ^» toider, who totenriews the 

period of time for ^«'r^J^:^^^J!tmT. taUrviw durii* . bl^ of 
Chapter 1 coordinator J^I^o^ R,rther, the team leader d>oald try 

m^^Ttr t^StS fToS^t.. a. W «ho.l site to assist h. 
L^rLr toward the school ta quesU™.. 

Questions for the Pa»P"f-»^*r^- ^r;*rc'J:i.SS^^^ 

SS'i^eS'iS^ir^^"-^--^** f.B.wing.,««U.ns: 
,„esUons p^,^ the discussion of ta?n.c«.n^ 

iSll^J^^S^^Wto - HOW does the principal promote the d«»ssK.n of 
instructional improvement?" 

their responsibiUty In relation to student achievement. 

The f ollowhig questions should be removed from the paraprofessional hiterview: 

9. How do you use test results to fanprove Instruction? 

14. Describe how you group for fastruction hi your classroom. 

21. How would you hnprove student assessment. 

„ was sugg^ U-at *e.custodian ^-l^^- ^"^'I't.^^rr,:^^ 
interview be «lded to the ^m&<m need to 

interview questionnaire: 

1: 1^ ?rgl3^te soppily to keep tiie buUding In good condition? 
9. S$ tiieiJ been . problem wtth vandalism hi tiie school? 
10 HowdoyouhiteractwitiittiechUdren? ^ ^ 
11. Is tiiere anythfaig you would like to say about tiie school? 

A lunchroom worker hiterview wiU not be added. 
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A Primary Specialist interview wiU not be added. 

^««ni#»nt« Some team members felt the 
The counsdor intcmew revived . "^r^«a^^rS „ r^Sl.«»«Poto«<'o«. 

need to drap it altogether, wtale ."^""fM "If^^"^^ i, ^ school. Fmther 

SattWstotemew should be more .datolM the dunes ottne^ ^ j^,^ 

L:SL:^-^er.seSSie^sh;..ai.a^PPedf«o.«.ep.ocess. 

Otherch^^esth^w^v^s^-l^rStfo^^^' ""^ 
23 from the faculty mterview. Recommenaav u 

instructional improvement?" 

,.efoUo«U«,»estiomsho-.abeeB«^Udfrom«.efac««,U*ervl.w: 

b It S^ho toiLtes It. ^ is the p»rp«e7 

On-Site Process logistics 

P«^»l«.ion of .natedals ijdpM;^ Z^^l^"^^^^ 
^members prior to the site vtats. "Dus "^J^"^ those doi.« muW^y vi*s. 
rj^. Furfter. it «as brought ^ ^^^^^^Zcmis. ReeommeBtotlon: Mot 
SLila folders were suggested ^ a «»y "^^^ X« with m «xW «t of taterriew 
^litntlri BUterirfs tor each sd.o«l W f ^ diouid org»to the 

^e two ,«son tean. -^^;„(r:fK^lo::SSL%^^^ 
Recommendation: The two person mterview tecnmqu 



the on-site visits. 



„«„»ggested.bat,hc«^aran^.c««^^ 

by priiuapals. Staff could be sdect^^ ^^^Jm «in be interviewed. Also, a grade 
and visitors ^^^.'^kT^ area teacher to the inte<v«we«. 

levd teacher could be ^-K"!" "^'t'^ ^^dKrs , but focus on a 
Another suggested techmqiK "f^ " 'XS^„ shoiUd be discussed further by tte 
Reeommendatlon: The to»e of , ust of tacutty «.d «Uff be provided 

Chapter X E«d».Uon ^^^^^ personnd tato . "compBanc. tr»n. of 
by the pitadpal at eadi school stte, nay pm s™"" 



mind' 
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The fonnula for interviewees should be as follows: 
Principal(l) 
Assistant Prindpal(l) 
Parentsd) 
Custodian(l) 

Instructional paraprofessional(l) 

S»p.^« tt> '"'^""^ '"^ ""^ 

Select Teachers at random 

.„ iniMviews and that it would be better to observe 
I, was brought up that th«e -^r^. '^^.ZZ. visits or walk-bys. Observers 
more, while interviewing lea. ^.f^Za^Za^^ to schedule classroom visits, 
should be available to walk thnwgh the ^od.Moa««^^ to each tean to tour the 

R«»mm«.datl«.: An «tta te»> ^ tactode student actWittes. classroom 

"^^n^^^ ^'^f^ «st that . w«h the prUKlp- 

;SSlJS;S2hf».d UUng photographs .t the sch«.l s*e. 

«^u.dngwas,cenasave^im,K«^t^ot.h^vi^It^^ 

pictures should be taken of students m ^^'^^^^J^Z^is. Recommendrtlont 

are available for use at the school rite. 

ScheduHng of f«^<' 'lir^'-^ ^Tr^^Lfp^ ^u^g'Tt 

while others were granted too ""f" J-f^T^ ttok fcrty-flve minutes. 

^ the schedules befbre -f^l^^Jf^ Jfi^X^ 
The dming w» fine ^.„^^^'";^r^n^t X »s«lWect infbnn^. 
Students should also be «0''''^J^^^,^^ top* of Interview diouM be tjven 

Xr"4e-^- - - - 

App^LSte times requi«d for the interviews are as follows: 

Principal - 60 minutes 
Assistant Principal - 60 mhiutes 

Vutat - 30 minutes 

Custodian - 25 minutes 

Instructional paraprofessional - 30 mfaiutes 

Teacher - 45 minutes 

District Chapter 1 Supervisor -1 hour + 

l«d.r Should review . .»..«« .d»d„l. furnish«l. b, the principal, before 
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U,e..««e visit .akespbce. ^„ Ttts would aUow more tin» 

,. was suggested that school visits be done in one and •^j'^^^^^aaUon: THe 

time and resource considerations. 

school Visits were , gteat ^.vantag. We^- T^^Z'^'t^ 

. , „f , checklist for the team leader. This nught 
Re^onsibiUties could be outlined in ^J'T'l^^M that would help the process. 

Reco»m«.daU»=T1.ete»nVe. ^. At this time details of the 

The visiting team members should aU meet ^^l^X^'^^, fte sctednle »«1 otha 
StSbe^ed. Hie location ^^J^J^ '^^S.iLndMlon: The vlstttag te-J 

SSd meet before «>« 0«!„t^,'t.S^'*^rdSde on fte toe needed to the 
or maps, the appropriate hiterview forms, ». 

rrinterviewers felt that <™S''ne:S^^ti^°^™^^?H^ 
7^o«s, on flie interview instruments, tha^ tot were phamed beforehand. 

^ ^usly decided ^ ".Sttetay responses would be sco.«l. 

members also fat flat tins '"^ "P^'^^Zmmdatton: The advisor, panel 
not see how ate scoring would be ^^^J^^^ need darlftartioB. 
SSlSVold . workshop for taU,^ to ^ ^ ^ ^ aiseussed by the 

'^p^SbTa video «. b«,k -s^^J^ - C*eS^i.^ Ugh, of .he ftct O^t 
XLis.vaUableforvie«««J^ote«m^^^^^ ^ ^ ^ "^""^ 
,>,e would not have gotten ti* sane ««>^ ^ ^.es. "^iT 

iboat the Successful Schools Project. 
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,n an undcrlvinE cause of success. "People can make a 



On-Site Team Summary Statements 
SiodTi district. Teamn^mboswho^^^ W^ ^,,^toeonc»y»s. the 

the -««^- ':-f^rr^^^ — « 

foUowing arc some of the major oui 
teams: 

OTe^nsdescribehighperfonningschooUaspositiveand^rong. 
in low performing schools. 

OT^n-sdUcussstaffdcvelopm^tin^ShP— .sehcoU.but..t^ 
performing schools. 

„hoXt.utn»tthclowperi6nmi.gschools. 

h,„« four (4) times as often inlowperfonningschooU as mtagh 
O Teams discuss change tour w umw « 
performing schools. 

OT.an»d.scri^««MsHperfonni«gxhooU,shavi.ga»nifled staff. 
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